Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Freelance Software Developer (Rust) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects.  Although every project is unique, you might typically: Generate prompts that challenge AI. Define comprehensive scoring criteria to evaluate the accuracy of the AI’s answers. Correct the model’s responses based on your domain-specific knowledge. How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have at least 3 years of professional experience with Rust. Code review experience is a must. Experience with AI projects is a plus. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
New York, NY, USA
$50
Workable
Senior Embedded Software Engineer (Networking)
About Us: Headquartered in the United States, TP-Link Systems Inc. is a leading global provider of networking devices and smart home products. Consistently ranked as the world's top provider of Wi-Fi devices, TP-Link is dedicated to delivering innovative solutions that improve people’s lives by offering faster, more reliable connectivity. Serving customers in over 170 countries, we are committed to expanding our global footprint. At TP-Link Systems Inc., we believe that technology has the power to transform the world for the better. Our mission is to design reliable, high-performance products that connect users worldwide to the limitless possibilities of technology. We are driven by our core values of professionalism, innovation, excellence, and simplicity. Our goal is to help clients achieve outstanding global performance and to provide consumers with a seamless, effortless technology experience. Overview: We are seeking a highly skilled and experienced Senior Embedded Software Engineer to design, develop, and optimize consumer networking products such as routers, access points, and switches. In this role, you will work closely with cross-functional teams to bring projects from concept to completion, participating in the research and development of various products, design and implement cutting-edge Wi-Fi and networking features. As a senior member of the team, you will lead feature architecture, troubleshoot complex issues, and provide mentorship to junior engineers, ensuring the delivery of high-performance, reliable products. Key Responsibilities: Collaborate with product management to conduct technical research and feasibility assessments that guide product design decisions. Design and develop embedded networking products, leading chipset bring-up, SDK integration, and application development across multiple hardware platforms. Conduct software architecture design and define system requirements to ensure efficient, scalable, and maintainable solutions. Partner with hardware teams to implement hardware-dependent functions and resolve integration challenges. Develop and optimize software features while analyzing and troubleshooting networking issues to ensure robust, high-performance connectivity. Create clear and comprehensive technical documentation, including design specifications, software architecture, and other necessary documents to support future development, maintainability, and effective collaboration. Lead design and code reviews to ensure high-quality standards, resolve issues, and incorporate team feedback. Manage the software development lifecycle, ensuring timely delivery and effective coordination with QA teams on testing and issue resolution. Oversee firmware releases and maintain detailed documentation, user manuals, and change logs for each update. Ensure product readiness for production by developing manufacturing tools, facilitating certifications, and providing on-site support as required. Investigate and address customer-reported issues, implementing firmware updates to enhance performance and resolve issues. Mentor junior engineers to enhance their coding, debugging, and software design skills, fostering team growth and capability. Conduct industry analysis to stay informed of trends and maintain a competitive edge in product offerings. Requirements Required Qualifications: Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience. 5+ years of experience in embedded systems design and development. Proficiency in programming languages such as C, C++, and assembly. Experience with embedded operating systems (e.g., Linux) and device drivers. Solid knowledge of communication protocols, such as TCP/IP, Ethernet, and Wi-Fi. Hands-on experience developing networking products, including access points, routers, and switches. Thorough knowledge of network protocols and standards, including HTTPS, DHCP, IPv4, and IPv6, with familiarity in Linux bridge and network stack internals. Experience with version control systems (e.g., Git) and continuous integration tools. Strong problem-solving and debugging skills. Excellent communication and leadership abilities. Preferred Qualifications: Strong understanding of professional software engineering practices and the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations. Experience as a mentor, tech lead, or in leading an engineering team. Experience developing products using Wi-Fi 6/7 chipsets. Experience working on requirements for Internet Service Providers (ISPs). Proficiency in the entire embedded networking stack, with strong technical expertise and problem-solving skills. Benefits Salary range: $140,000 - $200,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$140,000-200,000/year
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.