Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Embedded System Software Engineer (Smart Home)
About Us: Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology. Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle. Overview: We are seeking a Junior Embedded System Software Engineer (Smart Home) to design, develop, and optimize firmware for smart home products like Smart IP cameras, Smart Doorbells, etc. In this hands-on role, you will work closely with cross-functional teams to take features from concept to completion, ensuring high performance, reliability, and safety. You will be engaged in all stages of the development process, from chipset bring-up and SDK integration to new feature implementation. The software development work typically involves SoC chipsets running Linux and MCU subsystems operating in an RTOS environment. Key Responsibilities: Work with cross-functional teams to define system requirements and design effective solutions for smart home products. Participate in the software development process from initial design through production for TP-Link smart home devices. Write, debug, and test embedded software using C/C++ and other relevant programming languages. Bring up chip SDKs and integrate third-party features using cross-compiling techniques. Design and develop core modules such as audio/video transmission, control, connectivity, networking, and storage for smart home products. Work with Wi-Fi, Bluetooth BR/EDR/BLE protocols, and network stacks such as TCP/IP, Thread, BLE Mesh for diverse use cases. Troubleshoot and resolve complex issues in embedded systems to maintain product performance. Conduct unit tests, integration tests, and system validation. Ensure software meets performance, reliability, and security standards, including protocols to safeguard against vulnerabilities. Optimize code to meet requirements for performance, memory, and power efficiency. Produce technical documentation, including design specifications, software architecture, and user manuals. Work with external vendors and partners to integrate hardware and software components seamlessly. Adapt third-party platform SDKs and develop related use cases, such as Amazon, HomeKit, and Matter. Ensure product readiness for production by developing manufacturing tools, facilitating certifications, and providing on-site support as required. Investigate and address customer-reported issues, implementing firmware updates to enhance performance and resolve issues. Stay updated on trends in embedded systems, IoT, and connectivity protocols to continuously enhance product features and performance. Mentor and guide recent graduates, offering technical leadership and sharing best practices through code reviews and team collaboration. Requirements Required Qualifications: Bachelor's degree in computer science, Electrical Engineering, or a related field. 2+years of experience working with embedded software. Proficiency in embedded software programming using C/C++, with a strong understanding of coding best practices. Familiarity with embedded operating systems (e.g., RTOS, Linux) and real-time system design. Experience with hardware interfaces such as UART, SPI, I2C, and GPIO. Experience with network and security protocols in embedded systems (e.g., HTTP, MQTT, TLS). Understanding of software development life cycle, including version control, unit testing, and continuous integration. Strong problem-solving skills and attention to detail. Ability to work independently and within a team in a fast-paced environment. Preferred Qualifications: Experience with consumer electronics products software development, such as Smart IP cameras, Smart Doorbells, etc. Hands-on experience with SoC bring-up and integration. Knowledge of wireless communication protocols, such as Wi-Fi and BLE. Experience in video and audio encoding (AVC, HEVC, OPUS, etc) and streaming (WebRTC, RTP, RTSP, etc.) technologies. Proven experience in designing and developing core software modules. Strong communication, interpersonal, and project leadership skills. Ability to quickly adapt to new technologies and frameworks. Benefits Salary range: $100,000 - $140,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$100,000-140,000/year
Workable
Staff Cloud Software Engineer, Backend
About Us: Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.    Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.    Overview: At TP-Link Systems Inc., we are at the forefront of developing networking solutions that power millions of connections worldwide. As a Staff Cloud Software Engineer, Backend, you will play a crucial role in architecting the backbone of our cloud services. This position is tailored for a technical virtuoso who is passionate about building sophisticated backend systems that are not only scalable and efficient but also pioneering in the realm of cloud computing.   In this role, you will lead initiatives to design and implement robust backend architectures that support our vast range of network devices. Your expertise will drive the development of systems that handle massive amounts of data and transactions securely and seamlessly. By collaborating with cross-functional teams and utilizing cutting-edge technologies, you will enhance our ability to deliver premium services to our customers.   This opportunity is perfect for someone who seeks to tackle complex challenges and is eager to make a significant impact on the technological landscape. If you are driven by innovation, excellence, and the desire to develop systems that improve connectivity across the globe, we encourage you to apply and help shape the future of our technological solutions. Key Responsibilities: ·         Architect and lead the development of highly scalable and reliable backend services using advanced cloud-native technologies. ·         Drive the integration process with frontend engineers and cross-functional teams to ensure cohesive and seamless execution. ·         Evaluate and adopt state-of-the-art cloud technologies and methodologies to enhance application scalability, performance, and reliability. ·         Lead optimization initiatives for backend systems focusing on performance, scalability, and cost-efficiency. ·         Design and implement comprehensive security strategies to protect data and maintain application integrity. ·         Mentor and guide a little team of engineers, promoting best practices in coding, testing, and deployment. ·         Spearhead the automation of infrastructure provisioning and deployment frameworks. ·         Resolve sophisticated backend issues and provide strategic solutions to complex technical challenges. ·         Lead code reviews and continuously promote technical excellence. ·         Stay up to date on the latest cloud technologies and best practices. Requirements Qualifications: Master’s degree in Computer Science, Software Engineering, or a related field preferred. 7+ years of experience in cloud backend software development with proven leadership in managing substantial projects. Expertise in backend programming languages such as Java, and frameworks like SpringBoot. Deep understanding of JVM, multithreading programming, and performance optimization. Extensive experience with major cloud platforms (AWS, Azure, OCI) and cloud-based databases (e.g., MongoDB, SQL databases). Proficiency in distributed systems, including middleware such as message queues. Advanced knowledge in containerization technologies (Docker, Kubernetes) and modern backend technologies. Demonstrated capability in security best practices for cloud environments. Excellent communication, collaboration, and problem-solving skills. Ability to work effectively in a team environment. Preferred Qualifications: Proven track record with DevOps, serverless architectures, and SDN Software Controller Platforms. Experience with AI Ops and automation tools. Benefits Benefits:  Salary range: $140,000 - $200,000   Fully paid medical, dental, and vision insurance (partial coverage for dependents Contributions to 401k funds Over four weeks of PTO per year Bi-annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events    At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time. Apply for this job  
Irvine, CA, USA
$140,000-200,000/year
Craigslist
IT Technician – Software & Field Support (Westchester, Rockland, NYC)
About Us We’re a growing small business providing personalized IT support to clients across Rockland, Westchester, and New York City. Our mission is simple: solve problems thoroughly, patiently, and with dedication. We pride ourselves on being the trusted tech partner for individuals and small businesses alike. Role Overview We’re seeking a versatile and reliable IT Technician to provide software support across PC and Mac platforms. This role combines remote troubleshooting with onsite field visits, so a clean driver’s license and personal vehicle are essential. Responsibilities • Provide software support for both Windows and macOS environments • Troubleshoot and resolve client issues using AI tools and research as needed • Manage and respond to service requests via a work ticket system • Support and configure Microsoft Office 365 products, including Outlook, Word, Excel, and Teams • Assist with SharePoint and OneDrive setup, syncing, and permissions • Perform basic network troubleshooting and repair, especially for small Wi-Fi setups • Offer support for TV, streaming, and AV products when needed • Deliver remote and onsite support across our service area Requirements • Experience supporting PC and Mac platforms • Familiarity with Microsoft Office 365 suite and cloud services • Working knowledge of SharePoint and OneDrive on M365 • Strong troubleshooting skills with the ability to research and resolve issues independently • Basic networking skills, especially for small office/home Wi-Fi setups • Ability to use and manage a work ticket system • Clean driver’s license and reliable personal vehicle • Excellent communication, patience, and attention to detail • Commitment to solving client problems with care and professionalism ** Bonus Skills • Experience with AV setups, streaming devices, and smart TVs • Basic network wiring and crimping • Prior field service or remote support experience
775 Boston Post Rd, Rye, NY 10580, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.