Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Freelance Software Developer (C/C++ - Rust) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects.  Although every project is unique, you might typically: Analyze and understand existing code in Python or C/C++ Migrate logic to idiomatic, safe Rust while preserving functionality Adapt or port the test suite and ensure behavioral equivalence Document migration steps and technical decisions How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have at least 3 years of professional experience with C/C++ and 1+ year of hands-on experience with Rust. You are experienced with FFI tools (bindgen, cxx) and unsafe Rust for C/C++interoperability. You bring experience testing migrated code (unit/integration/fuzz tests). You demonstrate solid understanding of systems programming (memory management, concurrency). You are skilled at refactoring legacy code and documenting migration steps. Prompt engineering experience is a strong plus. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
New York, NY, USA
$50
Workable
Machine Learning Researcher / Engineer (Foundational Models)
About Pathway Pathway is building LiveAI™ systems that think and learn in real time as humans do. Our mission is to deeply understand how and why LLMs work, fundamentally changing the way models think. The team is made up of AI luminaries. Pathway's CTO, Jan Chorowski, co-authored papers with Geoff Hinton and Yoshua Bengio and was one of the first people to apply attention to speech. Our CSO, Adrian Kosowski, received his PhD in Theoretical Computer Science at the age of 20 and made significant contributions across numerous scientific fields, including AI and quantum information. He also served as a professor and a coach for competitive programmers at Ecole Polytechnique. The team also includes numerous world's top scientists and competitive programmers, alongside seasoned Silicon Valley executives. Pathway has strong investor backing. To date, we have raised over $15M; our latest reported round was our seed. Our offices are located in Palo Alto, CA, as well as Paris, France, and Wroclaw, Poland. The Opportunity This is an R&D position in attention-based models. We are currently searching for 1 or 2 R&D Engineers with a strong track record in machine learning models research. This is an extremely ambitious foundational project. There is a flexible GPU budget associated with this specific project, guaranteed to be in the 7-digit range minimum. You Will perform (distributed) model training. help improve/adapt model architectures based on experiment results. design new tasks and experiments. optionally: oversee activities of team members involved in data preparation. The results of your work will play a crucial role in the success of the project. Requirements Cover letter It's always a pleasure to say hi! If you could leave us 2-3 lines, we'd really appreciate that. You are expected to meet at least one of the following criteria: You have published at least one paper at NeurIPS, ICLR, or ICML - where you were the lead author or made significant conceptual & code contributions. You have significantly contributed to an LLM training effort which became newsworthy (topped a Huggingface benchmark, best in class model, etc.), preferably using multiple GPU's. You have spent at least 6 months working in a leading Machine Learning research center (e.g. at: Google Brain / Deepmind, Apple, Meta, Anthropic, Nvidia, MILA). You were an ICPC World Finalist, or an IOI, IMO, or IPhO medalist in High School. You Are A deep learning researcher, with a track record in Language Models and/or RL (candidates with a Vision or Robotics ML background are also welcome to apply). Interested in improving foundational architectures and creating new benchmarks. Experienced at hands-on experiments and model training (PyTorch, Jax, or Tensorflow). Have a good understanding of GPU architecture, memory design, and communication. Have a good understanding of graph algorithms. Have some familiarity with model monitoring, git, build systems, and CI/CD. Respectful of others Fluent in English Bonus Points Knowledge of approaches used in distributed training. Familiarity with Triton Successful track-record in algorithms & data science contests. Showing a code portfolio. Why You Should Apply Join an intellectually stimulating work environment. Be a pioneer: you get to work with a new type of "Live AI" challenges around long sequences and changing data. Be part of one of an early-stage AI startup that believes in impactful research and foundational changes. Benefits Type of contract: Full-time, permanent Preferable joining date: Immediate. The positions are open until filled – please apply immediately. Compensation: six-digit annual salary based on profile and location + Employee Stock Option Plan. Location: Remote work. Possibility to work or meet with other team members in one of our offices: Palo Alto, CA; Paris, France or Wroclaw, Poland. Candidates based anywhere in the EU, UK, United States, and Canada will be considered. If you meet our broad requirements but are missing some experience, don’t hesitate to reach out to us.
Palo Alto, CA, USA
$100,000/year
Workable
Sr Informatica ETL Developer III
· Responsible for detailed design, development/unit testing and support for integration testing · Experienced in both working with QA teams for integration testing as well as being responsible for testing own work (i.e. QA is not always involved in every task - ability to thoroughly test their own code is mandatory) · Produce scalable and flexible, high-quality code that satisfies both the functional and non-functional requirements · Identify technical issues & coordinate the resolution of these issues with technical lead team members · Uses secure development best practices and design patterns · Create or update design and systems documentation for developed or modified services or programs · Create process and data flow diagrams for data movement capture · Cross train team members for full knowledge coverage on team · Analyze and translate business requirements to technical design · Analyze and resolve technical issues · Collaborate/communicate with project team and business users as required · Support functional testing and performance testing · Works with technical delivery lead on project activities · Ensure assigned work is implemented within project schedules Incudes all developer skills, plus the following; ·Minimum of 7+ years overall IT experience ·Strong Automotive OEM experience a plus ·Experienced in waterfall, iterative, and agile methodologies # Informatica ·DBMS: Oracle, MYSQL, Cloudera DataLake/SQL experience ·Strong experience with Informatica programming across three main products BDM, Power Center and IICS - IDQ and ICRT experience is a plus. ·Skilled in Microsoft Office applications (Visio, Word, Excel, Access) ·Experience in both Unix and Windows platforms ·Design and develop Informatica workflows to exchange data with the Oracle databases, Salesforce, Data Lake or other operational or warehouse data stores ·Be able to create or modify Perl scripts for job control and process flow ·Additonal experience a plus: Axon
Auburn Hills, MI, USA
Negotiable Salary
Craigslist
*CDL* - COMPANY DRIVER, LEASE PURCHASE (REEFER) (Lombard)
***𝐃𝐌𝐍 𝐒𝐞𝐫𝐯𝐢𝐜𝐞𝐬 𝐈𝐧𝐜 𝐢𝐬 𝐇𝐈𝐑𝐈𝐍𝐆*** 𝐎𝐩𝐞𝐧 𝐩𝐨𝐬𝐢𝐭𝐢𝐨𝐧𝐬: - 𝗖𝗢𝗠𝗣𝗔𝗡𝗬 𝗗𝗥𝗜𝗩𝗘𝗥𝗦 - 𝐋𝐄𝐀𝐒𝐄 𝐓𝐎 𝐏𝐔𝐑𝐂𝐇𝐀𝐒𝐄 -----------------------------------------𝐖𝐞𝐥𝐜𝐨𝐦𝐞 𝐭𝐨 𝐃𝐌𝐍 𝐒𝐄𝐑𝐕𝐈𝐂𝐄𝐒 𝐈𝐧𝐜. ------------------------------ 𝐀𝐬 𝐟𝐨𝐫𝐦𝐞𝐫 𝐓𝐫𝐮𝐜𝐤 𝐃𝐫𝐢𝐯𝐞𝐫, 𝐈 𝐫𝐞𝐬𝐩𝐞𝐜𝐭 𝐚𝐧𝐝 𝐯𝐚𝐥𝐮𝐞 𝐲𝐨𝐮𝐫 𝐞𝐱𝐩𝐞𝐫𝐢𝐞𝐧𝐜𝐞 𝐢𝐧 𝐭𝐡𝐞 𝐓𝐫𝐚𝐧𝐬𝐩𝐨𝐫𝐭𝐚𝐭𝐢𝐨𝐧 𝐈𝐧𝐝𝐮𝐬𝐭𝐫𝐲. 𝐖𝐞 𝐤𝐧𝐨𝐰 𝐲𝐨𝐮𝐫 𝐬𝐭𝐫𝐮𝐠𝐠𝐥𝐞𝐬, 𝐲𝐨𝐮𝐫 𝐩𝐨𝐭𝐞𝐧𝐭𝐢𝐚𝐥. 𝐈𝐟 𝐲𝐨𝐮 𝐡𝐚𝐯𝐞 𝐠𝐨𝐚𝐥𝐬 𝐚𝐧𝐝 𝐚𝐫𝐞 𝐥𝐨𝐨𝐤𝐢𝐧𝐠 𝐟𝐨𝐫 𝐚 𝐬𝐭𝐚𝐛𝐥𝐞 𝐜𝐨𝐦𝐩𝐚𝐧𝐲 𝐭𝐨 𝐦𝐚𝐤𝐞 𝐠𝐨𝐨𝐝 𝐦𝐨𝐧𝐞𝐲 𝐚𝐧𝐝 𝐫𝐞𝐚𝐥𝐢𝐳𝐞 𝐲𝐨𝐮𝐫 𝐠𝐨𝐚𝐥𝐬 - 𝐲𝐨𝐮 𝐚𝐫𝐞 𝐚𝐭 𝐭𝐡𝐞 𝐫𝐢𝐠𝐡𝐭 𝐩𝐥𝐚𝐜𝐞. 𝐖𝐞 𝐚𝐫𝐞 𝐨𝐟𝐟𝐞𝐫𝐢𝐧𝐠 𝐚 𝐠𝐫𝐞𝐚𝐭 𝐨𝐩𝐩𝐨𝐫𝐭𝐮𝐧𝐢𝐭𝐲 𝐭𝐨 𝐨𝐰𝐧 𝐲𝐨𝐮𝐫 𝐭𝐫𝐮𝐜𝐤 𝐭𝐡𝐫𝐨𝐮𝐠𝐡 𝐨𝐮𝐫 𝐋𝐞𝐚𝐬𝐞 𝐭𝐨 𝐏𝐮𝐫𝐜𝐡𝐚𝐬𝐞 𝐩𝐫𝐨𝐠𝐫𝐚𝐦. ---𝐖𝐞 𝐤𝐧𝐨𝐰 𝐘𝐎𝐔𝐑 𝐓𝐈𝐌𝐄 𝐈𝐒 𝐕𝐀𝐋𝐔𝐀𝐁𝐋𝐄 𝐬𝐨 𝐰𝐞 𝐖𝐎𝐍'𝐓 𝐖𝐀𝐒𝐓𝐄 𝐈𝐓!--- ✅️ 𝗤𝗨𝗜𝗖𝗞 𝗛𝗜𝗥𝗜𝗡𝗚 𝗣𝗥𝗢𝗖𝗘𝗦𝗦!-----------------------------------------✅️ 𝗡𝗢 𝗘𝗦𝗖𝗥𝗢𝗪! ✅️ 𝗡𝗢 𝗙𝗨𝗘𝗟 𝗥𝗘𝗦𝗧𝗥𝗜𝗖𝗧𝗜𝗢𝗡𝗦!-----------------------------------------✅️ 𝗝𝗢𝗕 𝗦𝗘𝗖𝗨𝗥𝗜𝗧𝗬! ✅ 𝗙𝗜𝗡𝗔𝗡𝗖𝗜𝗔𝗟 𝗦𝗘𝗖𝗨𝗥𝗜𝗧𝗬! --------------------------------------------✅ 𝗖𝗔𝗥𝗘𝗘𝗥 𝗚𝗥𝗢𝗪𝗧𝗛! ✅𝗡𝗢 𝗙𝗢𝗥𝗖𝗘𝗗 𝗗𝗜𝗦𝗣𝗔𝗧𝗖𝗛!--------------------------------------------✅𝗗𝗥𝗜𝗩𝗘 𝗬𝗢𝗨𝗥 𝗪𝗔𝗬! ✅𝗗𝗶𝗿𝗲𝗰𝘁 𝗗𝗲𝗽𝗼𝘀𝗶𝘁 𝗪𝗘𝗘𝗞𝗟𝗬!------------------------------------------✅𝐂𝐚𝐬𝐡 𝐚𝐝𝐯𝐚𝐧𝐜𝐞𝐬 ! ✅𝗘𝘅𝗰𝗲𝗹𝗹𝗲𝗻𝘁 𝗲𝗾𝘂𝗶𝗽𝗺𝗲𝗻𝘁!----------------------------------------------✅𝗢𝗻𝗹𝗶𝗻𝗲 𝗢𝗿𝗶𝗲𝗻𝘁𝗮𝘁𝗶𝗼𝗻! ✅𝗦𝗵𝗼𝗽 𝗦𝗲𝗿𝘃𝗶𝗰𝗲! (𝗹𝗶𝘁𝘁𝗹𝗲 𝘁𝗼 𝗡𝗢 𝘄𝗮𝗶𝘁 𝘁𝗶𝗺𝗲𝘀)-----------------------✅𝗙𝘂𝗲𝗹 𝗰𝗮𝗿𝗱𝘀, 𝗜𝗣𝗔𝗦𝗦! ✅𝐑𝐞𝐰𝐚𝐫𝐝𝐬 𝐟𝐨𝐫 𝐂𝐋𝐄𝐀𝐍 𝐈𝐧𝐬𝐩𝐞𝐜𝐭𝐢𝐨𝐧𝐬 !----------------------------✅𝟮𝟰/𝟳 D𝗿𝗶𝘃𝗲𝗿/𝗘𝗟𝗗 𝘀𝘂𝗽𝗽𝗼𝗿𝘁 ! ✅𝐏𝐞𝐭 𝐅𝐫𝐢𝐞𝐧𝐝𝐥𝐲 - 𝐰𝐞 𝐥𝐨𝐯𝐞 𝐚𝐧𝐢𝐦𝐚𝐥𝐬 ! - - - - - - - - - - - 𝐋𝐄𝐀𝐒𝐄 𝐓𝐎 𝐏𝐔𝐑𝐂𝐇𝐀𝐒𝐄 - - - - - - - - - - - ⭐𝗚𝗘𝗧 𝗣𝗔𝗜𝗗 𝟴𝟓% 𝗼𝗳 𝗹𝗼𝗮𝗱𝘀! ⭐𝗚𝗿𝗼𝘀𝘀 𝗪𝗘𝗘𝗞𝗟𝗬 𝗶𝗻𝗰𝗼𝗺𝗲 $𝟴,𝟎𝟎𝟎 - $𝟏𝟎,𝟎𝟎𝟎 ⭐𝐍𝐎 𝐃𝐎𝐖𝐍 𝐏𝐀𝐘𝐌𝐄𝐍𝐓 ⭐𝐍𝐎 𝐂𝐑𝐄𝐃𝐈𝐓 𝐂𝐇𝐄𝐂𝐊 ⭐𝐍𝐎 𝐁𝐀𝐋𝐎𝐎𝐍 𝐏𝐀𝐘𝐌𝐄𝐍𝐓𝐒 ⭐𝐍𝐎 𝐇𝐈𝐃𝐃𝐄𝐍 𝐅𝐄𝐄𝐒 ⭐𝐘𝐎𝐔 𝐆𝐄𝐓 𝐓𝐈𝐓𝐋𝐄 𝐎𝐅 𝐓𝐇𝐄 𝐓𝐑𝐔𝐂𝐊 𝐀𝐓 𝐓𝐇𝐄 𝐄𝐍𝐃 𝐎𝐅 𝐘𝐎𝐔𝐑 𝐋𝐄𝐀𝐒𝐄 𝐓𝐄𝐑𝐌 - - - - - - - - - - - 𝐂𝐎𝐌𝐏𝐀𝐍𝐘 𝐃𝐑𝐈𝐕𝐄𝐑𝐒 - - - - - - - - - - - ⭐ 𝗦𝗜𝗚𝗡𝗜𝗡𝗚 𝗕𝗢𝗡𝗨𝗦 $𝟱,𝟮𝟬𝟬 ⭐ .𝟔𝟓𝐂𝐏𝐌 (𝐝𝐞𝐩𝐞𝐧𝐝𝐬 𝐨𝐧 𝐭𝐡𝐞 𝐞𝐱𝐩𝐞𝐫𝐢𝐞𝐧𝐜𝐞) 𝐎𝐍 𝐀𝐋𝐋 𝐀𝐂𝐓𝐔𝐀𝐋 𝐌𝐈𝐋𝐋𝐄𝐒 ⭐ 𝐀𝐔𝐓𝐎𝐌𝐀𝐓𝐈𝐂 𝐀𝐍𝐃 𝐌𝐀𝐍𝐔𝐀𝐋 𝐓𝐑𝐀𝐍𝐒𝐌𝐈𝐒𝐒𝐈𝐎𝐍 ⭐ 𝐅𝐋𝐄𝐗𝐈𝐁𝐋𝐄 𝐇𝐎𝐌𝐄 𝐓𝐈𝐌𝐄 ⭐ 𝐏𝐀𝐈𝐃 𝐃𝐄𝐓𝐄𝐍𝐓𝐈𝐎𝐍 ⭐ 𝐏𝐀𝐈𝐃 𝐃𝐎𝐖𝐍 𝐓𝐈𝐌𝐄 𝐑𝐞𝐪𝐮𝐢𝐫𝐞𝐦𝐞𝐧𝐭𝐬 - 𝟐𝐲𝐞𝐚𝐫𝐬 𝐞𝐱𝐩𝐞𝐫𝐢𝐞𝐧𝐜𝐞 (𝐭𝐫𝐮𝐜𝐤 𝐚𝐧𝐝 𝐫𝐞𝐞𝐟𝐞𝐫) ***𝘾𝙖𝙡𝙡 𝙉𝙊𝙒*** 𝗖𝗮𝗹𝗹 𝘂𝘀 𝘁𝗼𝗱𝗮𝘆 𝗮𝗻𝗱 𝗯𝗲𝗴𝗶𝗻 𝘆𝗼𝘂𝗿 𝗷𝗼𝘂𝗿𝗻𝗲𝘆 𝘄𝗶𝘁𝗵 𝗮 𝘁𝗲𝗮𝗺 𝘄𝗵𝗼 𝘄𝗮𝗻𝘁𝘀 𝘆𝗼𝘂 𝘁𝗼 𝘀𝘂𝗰𝗰𝗲𝗲𝗱! (𝟖𝟒𝟕) 𝟓𝟑𝟒-𝟕𝟒𝟗𝟖 Or Apply online https://form.jotform.com/251353149525052
719 S Charlotte St, Lombard, IL 60148, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.