Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Freelance Software Developer (C/C++ - Rust) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects.  Although every project is unique, you might typically: Analyze and understand existing code in Python or C/C++ Migrate logic to idiomatic, safe Rust while preserving functionality Adapt or port the test suite and ensure behavioral equivalence Document migration steps and technical decisions How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have at least 3 years of professional experience with C/C++ and 1+ year of hands-on experience with Rust. You are experienced with FFI tools (bindgen, cxx) and unsafe Rust for C/C++interoperability. You bring experience testing migrated code (unit/integration/fuzz tests). You demonstrate solid understanding of systems programming (memory management, concurrency). You are skilled at refactoring legacy code and documenting migration steps. Prompt engineering experience is a strong plus. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
Michigan, USA
$50
Workable
Freelance Software Developer (Python Engineer) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role We are looking for an experienced Python developer who enjoys building tools, environments, and infrastructure for working with LLM-based agents. You’ll help create sandboxes, task systems, and CI/CD pipelines to support testing and development of AI agents. You’ll also work closely with researchers and domain experts, helping them set up and use these tools effectively. Although every project is unique, you might typically: Sandboxes for running and testing AI agents safely Tools for writing tasks and test cases for agents CI/CD pipelines to run checks and evaluate agents Dev environments for experts creating these tasks Repo templates and scripts to help new contributors Interfaces for tracking task input and agent results Example Tasks How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have 5+ years of experience writing Python code. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
Texas, USA
$50
Craigslist
Cyber Security Engineer- Entry Level with Training!
Launch Your IT Career with Northstar Technologies At Northstar Technologies, we don’t just hire talent—we develop it. We’re looking for motivated problem-solvers who want to learn, grow, and build lasting careers in IT. If you bring curiosity, initiative, and the drive to take on challenges, we’ll provide the tools, training, and mentorship to help you succeed! Why Choose Northstar? We believe the best way to grow our company is to grow our people. That’s why every person starts with our hands-on, 3-month remote training program, designed to fast-track your skills with the guidance of team and access to enterprise-level equipment. What We Offer • Accelerated Learning:– In as little as 3 months (or faster, based on your pace). • Mentorship:Learn directly from experienced engineers committed to your growth. • Cutting Edge Tech: Train on modern, enterprise-grade infrastructure.. • Career Growth: Start at $22/hr with a clear path to raises and advancement. • Exciting Travel Opportunities : Gain valuable nationwide project experience, expand your professional network, and build skills in diverse environments. Work, travel, and explore! With 100% travel required, you’ll experience new cities and opportunities while your housing and relocation are fully covered. Comprehensive Benefits Medical, Dental, Vision, Life Insurance, and Paid PTO/Holidays. Who We’re Looking For Ideal candidates bring: • Problem-solving skills: You tackle challenges directly and seek new solutions. • A Willingness to Learn: You’re adaptable and eager to gain new skills. • A Team-Oriented Mindset: You value collaboration and open communication. • Attention to Detail: You’re organized and thorough. • Practical Thinking: You approach problems with an open mind and resourcefulness. Requirements: • Ability to pass a comprehensive background check (including criminal history) and drug screen. • 100% travel and relocation required (company provides housing and relocation support). • Flexibility to live and work in project cities for extended periods. • Authorization to work in the U.S. Ready to Move Forward? Send your resume to info@northstar-tek.com and start your journey with Northstar Technologies. We help businesses transform through technology, providing secure, agile, and cloud-ready IT infrastructure solutions. Our services range from strategy and consulting to design, implementation, and support.
9706 E 85th Pl, Tulsa, OK 74133, USA
$22/hour
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.