Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
.NET API Specialist
Role: .NET API Specialist Location: Dallas, TX(4 days onsite)- . Yrs of exp:10+   Your responsibilities in this role will include: Lead the design, development, and implementation of robust and scalable .NET Core APIs. Hands-on Knowledge on SQL queries Collaborate with cross-functional teams to gather requirements and architect solutions. Hands-on coding and debugging of API components to ensure high performance and reliability. Mentor junior developers and provide technical guidance and support. Stay current with industry trends and best practices, particularly in cloud technologies. Extensive experience in developing .NET APIs using C#. Strong proficiency in cloud platforms such as AWS, Azure, or Google Cloud Platform. Demonstrated expertise in designing and implementing RESTful APIs. Solid understanding of software development methodologies and practices. Excellent communication skills and ability to collaborate effectively with teams. Knowledge of microservices architecture. Familiarity with DevOps practices and tools.   Requirements: Bachelor’s degree in computer science, Engineering, or a related field. Proven experience as a .NET/C# Developer with a minimum of 8 years in software development. Strong proficiency in C#, ASP.NET, and the .NET Framework. Solid understanding of software development principles and best practices. Good in database systems (Oracle RDBMS, etc.). Excellent problem-solving and communication skills. Ability to work independently and collaboratively within a team. Primary skills:  SQL NET API AZURE AWS KUBERNETES ORACLE RDBMS KAFKA DOCKER KUBERNETES CI/CD PIPELINE C#
Dallas, TX, USA
Negotiable Salary
Workable
Elite Applications Engineer
Seeking a full-time Enterprise Applications Engineer for an on-site role. This person will be responsible for administration, monitoring and maintenance of the Accounting enterprise applications. Responsibilities: Administer and support the Firm's Elite 3E platform Serves as the subject matter expert and technical resource for the Firm’s financial system both within the financial group and the IT department by providing expertise on issues of functionality, integration, performance/troubleshooting, design, deployment etc. Administer all other systems in the Firm’s financial platform including various supporting systems in the 3E Elite application and tools including (but not limited to) Paperless Performa, IDE, Design Gallery (EDG), Workspace. Responsible for the administration and support tasks related to the Elite 3E system. This can include but is not limited to: Scheduled month-end maintenance Upgrades to 3E, Workspace, and other related software systems Coordinate with database and application administrators on projects which are related to the financial system Responsible for development deliverables of Elite 3E customizations (forms, inquiries, reports, metrics, etc.) with quality and consistent integration between key financial applications and Document customization solutions. Analyze and work with the Financial team users and IT team on the impact of vendor software upgrades Coordinates with both the Accounting and IT team, to prioritize and address issues and objectives for financial systems Responsible for testing financial system applications during system changes, enhancements, upgrades and monthly system maintenance, as well as, documentation of system integrations, backup and disaster recovery processes Project Management - create, track and update all Elite 3E customization and new project tasks. Work closely with the Accounting team to deliver strategic projects Informs the department and management in a timely manner of project status, issues and proposed resolutions. Manage vendor support tickets Track and optimize system performance and storage utilization, plan for necessary hardware or software upgrades to support system growth Research and evaluate new technologies to improve current application processes. Utilize tools to protect application source code, and maintain versioning. Requirements 3+ years’ experience operating with legal accounting and time management software required, experience with Elite 3E preferred Experience with maintaining Proforma Tracker, 3E Templates, 3E Workspace and BizTalk. Proficiency in Elite Application Framework and Tools, including the IDE, Design Gallery (EDG) Experience administering Windows Server Intermediate to advanced knowledge of SQL Application installation and configuration experience Fluency in the Elite 3E SQL database schema preferred or demonstrated ability to develop such fluency 5+ years’ experience in the management, design and implementation of Windows computer systems. Experience administering and maintaining Microsoft SQL and MS Active Directory is desirable. Experience with iManage document management administration, Thomson Reuters 3e Accounting management systems and Foundations system administration preferred. Microsoft Certified Systems Engineer (MCSE) preferred, but not required.
Hackensack, NJ, USA
Negotiable Salary
Workable
TIBCO Developer
Role: TIBCO Developer Location: Jackson MI -  Hybrid mode Position Type: Contract   We are seeking a TIBCO Developer to join the integration team supporting Consumers Energy in Jackson, MI. The ideal candidate will have strong expertise in TIBCO Business  Works 6.x and a solid understanding of enterprise integration patterns.   Responsibilities:   ·       Design, develop, and support integration solutions using TIBCO BusinessWorks 6.x and 5.x, TIBCO EMS, API development and TIBCO BusinessEvents. ·       Develop and maintain APIs using TIBCO API Exchange, including RESTful and SOAP web services ·       Configure and monitor messaging using TIBCO EMS, Hawk, and Rendezvous ·       Collaborate with business analysts, architects, and other developers to deliver high-quality integration solutions ·       Troubleshoot and resolve production issues in a timely manner ·       Participate in code reviews and deployment processes ·       Ensure integration components adhere to security, performance, and scalability standards   Required Qualifications:   ·       5+ years of hands-on experience with: ·       TIBCO BusinessWorks (BW) 6.x and 5.x ·       TIBCO EMS, Hawk, BusinessEvents ·       TIBCO Rendezvous and API Exchange Gateway ·       Solid understanding of SOA and integration architecture ·       Experience with RESTful and SOAP APIs ·       Familiarity with DevOps, CI/CD pipelines, and Git-based versioning ·       Strong debugging and troubleshooting skills in enterprise environments ·       Ability to work independently in a hybrid/remote setup ·       Strong verbal and written communication skills   Nice to Have:   ·       Knowledge of Containers (Docker/Kubernetes) and Cloud platforms (Azure or AWS) ·       Experience with other integration technologies or scripting languages ·       Prior experience working in utility or energy sectors   Note: they need BW and BE development skills, not just one or the other, can good comminication skills, clear english, I am also asking if they are willing to relocate to Jackson Mi, along with API development  
Jackson, MS, USA
Negotiable Salary
Workable
Freelance Software Developer (Golang) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects.  Although every project is unique, you might typically: Generate prompts that challenge AI. Define comprehensive scoring criteria to evaluate the accuracy of the AI’s answers. Correct the model’s responses based on your domain-specific knowledge. How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in software development, computer science, or other related fields. You have at least 3 years of professional experience. Your level of English is advanced (C1) or above. Code review experience is must. Experience with AI projects is a plus. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
Colorado, USA
$50
Workable
Principal Software Engineer - Node
Job Summary A Principal Software Engineer for Node is an associate at Creative Chaos who is mainly responsible for developing server applications of various software platforms including but not limited to writing Restful APIs to be consumed by client applications. A principal software engineer makes sure that the functionality, security and performance of the server application is as per the design and is completely bug free. Principal engineers have a responsibility to lead a team of engineers, mentor team members through continuous training and guidance. Duties & Responsibilities Lead a team of software engineers Mentor team members through training and guidance Analyze business requirements Estimate assigned tasks Write code and unit tests Collaborate with other team members Tune your code for enhanced security and performance Maintain systems by fixing any existing issues Update issue tracking software Provide status updates Communicate with client Control versions of your code Research new technologies Upgrade skills and knowledge Evaluate candidates for open positions Requirements Minimum Bachelors in Computer Science/Software Engineering or equivalent. Minimum 6-8 years of related experience in professional industry Strong communication skills Strong proficiency in Javascript technologies Knowledge of NodeJS and its available frameworks such as ExpressJS and NestJS Knowledge and experience in writing backend components and Restful APIs Understanding of accessibility standards and security compliances Working knowledge of Typescript, Azure functions, YAML, Terraform is preferred. Experience with different relational and schemaless databases such as MySQL, PostgreSQL and MongoDB Creating database structure for the required functionality Experience with writing unit tests and ensuring the minimum 90% test coverage Knowledge of and experience with Github, JIRA and other collaboration tools Understanding of security standards and compliances Basic understanding of front-end technologies. Flexible attitude and versatile personality Strong presentation skills Strong influence among team members
Lahore, Pakistan
Negotiable Salary
Workable
Freelance Software Developer (Python-Rust) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects. Although every project is unique, you might typically: Analyze and understand existing code in Python or C/C++ Migrate logic to idiomatic, safe Rust while preserving functionality Adapt or port the test suite and ensure behavioral equivalence Document migration steps and technical decisions How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have at least 3 years of professional experience with Python, 1+ year of Rust (or fast learning capability). Your level of English is advanced (C1) or above. Experience with PyO3/maturin for Python-Rust interoperability. Knowledge of Docker, Kubernetes, and CI/CD for hybrid Python-Rust apps. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
Michigan, USA
$50
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.