Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Senior Embedded System Software Engineer (Communication)
Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.  Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.  Overview: We are seeking a skilled Senior Embedded Software Engineer to design, develop, and optimize enterprise networking products such as routers, access points and so on. In this hands-on role, you will collaborate closely with cross-functional teams to bring features from concept to completion, ensuring high standards of performance, reliability, and safety. You will be involved in every stage of the product life cycle, including development, manufacture, and maintenance and so on. Key Responsibilities: Design, develop, and maintain software systems for embedded network devices. Design and integrate network solutions into overall architecture and hardware design across multiple platforms Responsible for device driver development and maintenance, such as Flash, Wi-Fi, wired network etc. Design and development of features in the area of L2/Bridging/L3/Routing for the network devices. Implement, maintain, troubleshoot, and improve manufacturing processes, including maintaining flow charts, develop manufacture software, identify and fix issues, and make improvements and so on.  Work closely with hardware team to deliver high quality products. ·Responsible for design and development review of software systems. Responsible for identifying and fixing bugs prior to software release. Write clean, maintainable, and well-documented code. Implement software features of high quality and on schedule. Collaborate seamlessly with cross-functional teams, including designers, product managers, and QA engineers, to deliver unparalleled user experiences. Provide technical leadership, mentorship, and guidance to junior team members, fostering a collaborative and high-performing environment. Conduct meticulous code reviews and provide mentorship to junior developers, ensuring strict adherence to coding standards and industry best practices. Requirements Bachelor’s degree in computer science, Software Engineering, or a related field. Minimum of 5 years of related experience. Proficiency in embedded software programming skills with C/C++ language. Experience with embedded Linux kernel and application development. Experience with audio/video encoding, motor controls software development. Proficiency in ONVIF, RTCP, RTSP application development. Knowledge of network technology including NAT, TCP, UDP, IPv4, IPv6, HTTP etc. Experience in analyzing crash logs, stack trace, faults by utilizing basic debugging techniques Experience with version control systems (e.g., Git). Highly motivated, positive, detail oriented and responsible. Preferred Qualifications: Experience with designing and delivering storage software modules. The storage device may be a TF card, hard disk (SSD/HDD/HHD), NAS, and so on. Deep knowledge of Linux kernel internals (process scheduler, concurrency, synchronization, memory allocation, file systems). Knowledge of wireless communication protocols, e.g. 802.11a/b/g/n/ac/ax/be. Benefits Salary range: $140,000 - $200,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$140,000-200,000/year
Workable
Embedded System Software Engineer (Smart Home)
About Us: Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology. Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle. Overview: We are seeking a Junior Embedded System Software Engineer (Smart Home) to design, develop, and optimize firmware for smart home products like Smart IP cameras, Smart Doorbells, etc. In this hands-on role, you will work closely with cross-functional teams to take features from concept to completion, ensuring high performance, reliability, and safety. You will be engaged in all stages of the development process, from chipset bring-up and SDK integration to new feature implementation. The software development work typically involves SoC chipsets running Linux and MCU subsystems operating in an RTOS environment. Key Responsibilities: Work with cross-functional teams to define system requirements and design effective solutions for smart home products. Participate in the software development process from initial design through production for TP-Link smart home devices. Write, debug, and test embedded software using C/C++ and other relevant programming languages. Bring up chip SDKs and integrate third-party features using cross-compiling techniques. Design and develop core modules such as audio/video transmission, control, connectivity, networking, and storage for smart home products. Work with Wi-Fi, Bluetooth BR/EDR/BLE protocols, and network stacks such as TCP/IP, Thread, BLE Mesh for diverse use cases. Troubleshoot and resolve complex issues in embedded systems to maintain product performance. Conduct unit tests, integration tests, and system validation. Ensure software meets performance, reliability, and security standards, including protocols to safeguard against vulnerabilities. Optimize code to meet requirements for performance, memory, and power efficiency. Produce technical documentation, including design specifications, software architecture, and user manuals. Work with external vendors and partners to integrate hardware and software components seamlessly. Adapt third-party platform SDKs and develop related use cases, such as Amazon, HomeKit, and Matter. Ensure product readiness for production by developing manufacturing tools, facilitating certifications, and providing on-site support as required. Investigate and address customer-reported issues, implementing firmware updates to enhance performance and resolve issues. Stay updated on trends in embedded systems, IoT, and connectivity protocols to continuously enhance product features and performance. Mentor and guide recent graduates, offering technical leadership and sharing best practices through code reviews and team collaboration. Requirements Required Qualifications: Bachelor's degree in computer science, Electrical Engineering, or a related field. 2+years of experience working with embedded software. Proficiency in embedded software programming using C/C++, with a strong understanding of coding best practices. Familiarity with embedded operating systems (e.g., RTOS, Linux) and real-time system design. Experience with hardware interfaces such as UART, SPI, I2C, and GPIO. Experience with network and security protocols in embedded systems (e.g., HTTP, MQTT, TLS). Understanding of software development life cycle, including version control, unit testing, and continuous integration. Strong problem-solving skills and attention to detail. Ability to work independently and within a team in a fast-paced environment. Preferred Qualifications: Experience with consumer electronics products software development, such as Smart IP cameras, Smart Doorbells, etc. Hands-on experience with SoC bring-up and integration. Knowledge of wireless communication protocols, such as Wi-Fi and BLE. Experience in video and audio encoding (AVC, HEVC, OPUS, etc) and streaming (WebRTC, RTP, RTSP, etc.) technologies. Proven experience in designing and developing core software modules. Strong communication, interpersonal, and project leadership skills. Ability to quickly adapt to new technologies and frameworks. Benefits Salary range: $100,000 - $140,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$100,000-140,000/year
Workable
.Net Developer
Role: .Net Developer Location: Redmond, WA(Onsite) Position Type: Contract Job Description:- Must Have Skills: • 3+ years of hands-on development experience with Kubernetes/Azure Kubernetes Service (AKS) Experience with Azure DevOps or GitHub Actions for CI/CD pipelines • 6+ years of experience in software development using C# and .NET Core /.NET Framework • Working on DevSecOps practices and secure coding standards for AKS deployments • Cloud above ARM deployment experience and CIS/RPv2 Deployments • ARM Templates: Expertise in authoring and modifying Azure Resource Manager (ARM) templates Good to Have Skills: •  Experience with other Azure services such as Azure SQL, Azure Data Factory, and Blob Storage •  Knowledge of RESTful APIs and microservices architecture •  Python, PowerShell, YAML/JSON •   Certifications such as Microsoft Certified: Azure Developer Associate or Kubernetes Administrator Responsibilities: •  Design, develop, and maintain C# applications for cloud-native environments. •  Automate deployment workflows for AKS and Above ARM services •  Integrate CIS buildout automation into existing pipelines and workflows •  Collaborate with cloud engineers, DevOps, and security teams to ensure secure and scalable deployments •  Troubleshoot and resolve deployment issues across environments •  Maintain documentation and contribute to continuous improvement of buildout processes
Redmond, WA, USA
Negotiable Salary
Craigslist
Full-Time Program Director / Station Manager (Midtown West)
Job Title: Full-Time Program Director / Station Manager Location: New York, NY Midtown. Compensation: $1,200 per week | 40 hours per week | Includes paid vacation, sick days, and holidays About Us: We are a growing online radio network dedicated to delivering high-quality programming that informs, entertains, and engages a diverse audience. Our mission is to provide listeners with compelling shows and to continually raise the bar for excellence in online broadcasting. Position Overview: We are seeking a skilled and motivated Program Director / Station Manager with strong experience as a Board Operator. This dual-role position requires both technical expertise and leadership abilities. The Program Director / Station Manager will oversee day-to-day operations, ensure the quality of programming and broadcast sound, manage host relations, and grow the network’s reach and listenership. Key Responsibilities: Operate the broadcast board to ensure seamless programming and professional sound quality. Manage the programming schedule, coordinating with hosts and producers to maintain consistency and balance across shows. Monitor live and recorded programming to maintain high standards for content and technical quality. Address performance issues by removing shows that do not meet quality standards. Recruit and onboard new hosts and shows that align with the station’s mission and enhance the programming lineup. Serve as the main point of contact for hosts, supporting their technical and scheduling needs. Develop and implement strategies to increase audience engagement and overall listenership. Ensure smooth day-to-day station operations, including troubleshooting technical issues as needed. Qualifications: Prior experience as a board operator (required). Experience in radio station management or programming coordination. Strong technical skills in sound mixing, broadcasting software, and online radio platforms. Excellent organizational, leadership, and communication skills. Ability to make programming decisions with professionalism and fairness. Creative mindset for growing listenership and building engaging radio content. Compensation & Benefits: $1,200 per week for a 40-hour work week. Paid vacation days, sick days, and holidays. Opportunity to lead and shape the future of a dynamic online radio station. How to Apply: If you are passionate about online radio, skilled in both the technical and managerial aspects of broadcasting, and eager to make a real impact on our station’s growth, we’d love to hear from you. Please reply with your resume and a cover letter detailing your relevant experience and vision for growing an online radio station!
357A 8th Ave, New York, NY 10001, USA
$1,200/month
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.