Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Principal Software Engineer - Node
Job Summary A Principal Software Engineer for Node is an associate at Creative Chaos who is mainly responsible for developing server applications of various software platforms including but not limited to writing Restful APIs to be consumed by client applications. A principal software engineer makes sure that the functionality, security and performance of the server application is as per the design and is completely bug free. Principal engineers have a responsibility to lead a team of engineers, mentor team members through continuous training and guidance. Duties & Responsibilities Lead a team of software engineers Mentor team members through training and guidance Analyze business requirements Estimate assigned tasks Write code and unit tests Collaborate with other team members Tune your code for enhanced security and performance Maintain systems by fixing any existing issues Update issue tracking software Provide status updates Communicate with client Control versions of your code Research new technologies Upgrade skills and knowledge Evaluate candidates for open positions Requirements Minimum Bachelors in Computer Science/Software Engineering or equivalent. Minimum 6-8 years of related experience in professional industry Strong communication skills Strong proficiency in Javascript technologies Knowledge of NodeJS and its available frameworks such as ExpressJS and NestJS Knowledge and experience in writing backend components and Restful APIs Understanding of accessibility standards and security compliances Working knowledge of Typescript, Azure functions, YAML, Terraform is preferred. Experience with different relational and schemaless databases such as MySQL, PostgreSQL and MongoDB Creating database structure for the required functionality Experience with writing unit tests and ensuring the minimum 90% test coverage Knowledge of and experience with Github, JIRA and other collaboration tools Understanding of security standards and compliances Basic understanding of front-end technologies. Flexible attitude and versatile personality Strong presentation skills Strong influence among team members
Lahore, Pakistan
Negotiable Salary
Workable
Senior Software Engineer
Senior Software Engineer Job Type: C2C Duration: Long Term Location: Edmond, OK What You’ll Do ●       Develop organizational software for using the appropriate tools and techniques for each platform in span of care. ●       Review and test existing code-base or technical integrations for various projects. ●       Provide support to other Client Engineers by reviewing, testing, and approving code/software development. ●       Collaborate with various teams and team members to determine the technical approach and to organize development plans. ●       Evaluate the complexity of tasks and provide realistic estimates on the level of effort and completion time. ●       Partner with junior and mid-level engineers to offer training and guidance on best practices. ●       Help ensure that other engineers are moving in the same technical direction. ●       Maintain strategic outlook to plan for future development of processes and team. ●       Provide technical support on escalated software issues. ●       Research industry best practices and new technologies or tools that could be implemented at Life.Church. Skills Needed To Succeed ●       Proficient in modern web technologies, such as TypeScript, React, and NextJS. ●       Excellent verbal, written, and interpersonal communication skills to maintain relationships and partnerships. ●       Maintain a systematic and organized approach to completing assignments accurately, thoroughly, and timely. ●       Clearly explain complicated and detailed processes in a concise and simple way. ●       Ability to self-motivate, take initiative, make independent decisions, and problem-solve. ●       Ability to collaborate in a team environment and work independently. ●       Ability to maintain composure during stressful situations. ●       Own technical design for projects and understand, and articulate, the trade-offs in creating high-quality software. ●       High School Diploma or GED. ●       Bachelor’s degree in computer science preferred. ●       4+ years of related work experience.    
Edmond, OK, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.