Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Craigslist
Autonomous Vehicle Operators (SAN FRANCISCO)
PLEASE FORWARD RESUME FOR CONSIDERATION Royalty Staffing is currently hiring Autonomous Vehicle Operator in San Francisco for our client who is a growing ride-share company. This is an excellent opportunity to be at the forefront of turning the company's vision into reality. We're looking for operators who are disciplined, team players, and believe in doing whatever it takes to accomplish the mission. Working as a VO will give you the opportunity to learn vehicle and personnel operations. You'll have a front-row seat to the operational complexities of realizing autonomous mobility and the chance to contribute to the future. We are currently hiring for multiple schedules, with bonus pay for weekend and night shifts with a start time of after 3pm (i.e. the weekend day shift offers an added 5% per hour and weekend night shift offers an added 10% per hour). Location – San Francisco, CA Work environment – Onsite/field Pay rate - 29.00 USD Per Hour Assignment duration – Ongoing contract SCHEDULE Hours: Day Shift: 5:45am-2:15pm, 6:45am-3:15pm, or 7:45am-4:15pm Night Shift: 1:45pm-10:15pm, 2:45pm-11:15pm, 3:45pm-12:15am, or 5:45pm-2am Days: Wednesday-Sunday Thursday-Monday Friday-Tuesday Saturday-Wednesday RESPONSIBILITIES Support vehicle operations. Drive 4-8 hours a day with a priority on safety. Conduct basic software operation tasks. Support missions through a wide variety of roles in and out of vehicles. Assist with documentation and metrics. Provide accurate written and oral feedback to engineering teams. Support vehicle maintenance and logistics. Conduct daily basic vehicle preventative maintenance checks, services, and repairs. Provide logistical support for the movement and storage of vehicles and equipment. Ensure the readiness and cleanliness of vehicles, equipment, and the workplace. Assist with paperwork and documentation related to vehicle readiness. REQUIREMENTS Basic vehicle knowledge to perform vehicle checks, ability to drive for long duration (6 hours in the car per day) Basic technology ability Excellent written and verbal communication skills Excellent driving history and no criminal history Proactive mindset and resourcefulness Bachelor's degree or equivalent technical experience is a plus BENEFITS Pre-tax commuter benefits Employer Subsidized healthcare benefits Flexible Spending Account for healthcare-related costs All costs for short- and long-term disability and life insurance 401k package
1422 Douglass St, San Francisco, CA 94131, USA
$29/hour
Workable
Freelance Software Developer (Rust) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects.  Although every project is unique, you might typically: Generate prompts that challenge AI. Define comprehensive scoring criteria to evaluate the accuracy of the AI’s answers. Correct the model’s responses based on your domain-specific knowledge. How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have at least 3 years of professional experience with Rust. Code review experience is a must. Experience with AI projects is a plus. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
Michigan, USA
$50
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.