Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Senior Big Data Engineer
ABOUT US: Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.  Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.  KEY RESPONSIBILITIES Develop and maintain the Big Data Platform by performing data cleansing, data warehouse modeling, and report development on large datasets. Collaborate with cross-functional teams to provide actionable insights for decision-making. Manage the operation and administration of the Big Data Platform, including system deployment, task scheduling, proactive monitoring, and alerting to ensure stability and security. Handle data collection and integration tasks, including ETL development, data de-identification, and managing data security. Provide support for other departments by processing data, writing queries, developing solutions, performing statistical analysis, and generating reports. Troubleshoot and resolve critical issues, conduct fault diagnosis, and optimize system performance. Requirements REQUIRED QUALIFICATIONS Bachelor’s degree or higher in Computer Science or a related field, with at least three years of experience maintaining a Big Data platform. Strong understanding of Big Data technologies such as Hadoop, Flink, Spark, Hive, HBase, and Airflow, with proven expertise in Big Data development and performance optimization. Familiarity with Big Data OLAP tools like Kylin, Impala, and ClickHouse, as well as experience in data warehouse design, data modeling, and report generation. Proficiency in Linux development environments and Python programming. Excellent communication, collaboration, and teamwork skills, with a proactive attitude and a strong sense of responsibility. PREFERRED QUALIFICAITONS Experience with cloud-based deployments, particularly AWS EMR, with familiarity in other cloud platforms being a plus. Proficiency in additional languages such as Java or Scala is a plus. Benefits Salary Range: $150,000 - $180,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$150,000-180,000/year
Workable
Senior Embedded System Software Engineer (Communication)
Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.  Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.  Overview: We are seeking a skilled Senior Embedded Software Engineer to design, develop, and optimize enterprise networking products such as routers, access points and so on. In this hands-on role, you will collaborate closely with cross-functional teams to bring features from concept to completion, ensuring high standards of performance, reliability, and safety. You will be involved in every stage of the product life cycle, including development, manufacture, and maintenance and so on. Key Responsibilities: Design, develop, and maintain software systems for embedded network devices. Design and integrate network solutions into overall architecture and hardware design across multiple platforms Responsible for device driver development and maintenance, such as Flash, Wi-Fi, wired network etc. Design and development of features in the area of L2/Bridging/L3/Routing for the network devices. Implement, maintain, troubleshoot, and improve manufacturing processes, including maintaining flow charts, develop manufacture software, identify and fix issues, and make improvements and so on.  Work closely with hardware team to deliver high quality products. ·Responsible for design and development review of software systems. Responsible for identifying and fixing bugs prior to software release. Write clean, maintainable, and well-documented code. Implement software features of high quality and on schedule. Collaborate seamlessly with cross-functional teams, including designers, product managers, and QA engineers, to deliver unparalleled user experiences. Provide technical leadership, mentorship, and guidance to junior team members, fostering a collaborative and high-performing environment. Conduct meticulous code reviews and provide mentorship to junior developers, ensuring strict adherence to coding standards and industry best practices. Requirements Bachelor’s degree in computer science, Software Engineering, or a related field. Minimum of 5 years of related experience. Proficiency in embedded software programming skills with C/C++ language. Experience with embedded Linux kernel and application development. Experience with audio/video encoding, motor controls software development. Proficiency in ONVIF, RTCP, RTSP application development. Knowledge of network technology including NAT, TCP, UDP, IPv4, IPv6, HTTP etc. Experience in analyzing crash logs, stack trace, faults by utilizing basic debugging techniques Experience with version control systems (e.g., Git). Highly motivated, positive, detail oriented and responsible. Preferred Qualifications: Experience with designing and delivering storage software modules. The storage device may be a TF card, hard disk (SSD/HDD/HHD), NAS, and so on. Deep knowledge of Linux kernel internals (process scheduler, concurrency, synchronization, memory allocation, file systems). Knowledge of wireless communication protocols, e.g. 802.11a/b/g/n/ac/ax/be. Benefits Salary range: $140,000 - $200,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$140,000-200,000/year
Workable
Senior Developer
As a Senior Developer, this position will work with a growing team on innovative and leading-edge solutions with our Video Entertainment Team.  You will join an existing motivated and productive development team who is delivering enterprise-level solutions related to delivery and playback of Hollywood content.  Swank works closely with major Hollywood studios in providing leading edge solutions for content consumption. This position is responsible for upholding the values and mission of the Information Technologies Department, this includes the establishment of customer service and satisfaction standards. Communication and understanding of customer objectives and our progress toward fulfilling these objectives is paramount to the success of this role. This position will work in a team environment using a variety of technologies for building leading edge solutions for both internal, as well as customer-facing media playback solutions.  Solutions employ advanced video security techniques including forensic watermarking, Digital Rights Management (DRM) and encryption. Technologies used include but are not limited to: Work on the latest web technologies including: Angular, .Net Core, Web API and Typescript Work on the latest technologies of .Net Core and .Net 4 Windows Server and Linux Docker/Kubernetes Requirements 8+ years of C# experience 6+ years of ASP.NET development, including MVC 4/5 development Strong Web Development: Typescript, HTML5 using frameworks like Angular or similar Strong knowledge of object-oriented programming Strong knowledge of web API/REST Strong knowledge of documenting technical specifications Experience with Git Experience with using SQL Server as a backend preferred Experience with Entity Framework Experience with a Continuous integration toolset (Azure DevOps, Teamcity, or similar) Experience with using SQL Server as a backend preferred Experience with Entity Framework and Dapper Significant experience writing unit tests for code including client script Experience with Docker/Kubernetes as plus Ability to quickly become productive with new technologies Proven experience delivering solutions into production Must be a self-starter Excellent communication skills Must be able to participate in design and code reviews Must be able to assist team members in the completion of tasks and assignments to ensure project completion Must be able to mentor junior development team staff and ensure completion of assigned projects by the team Bachelor’s Degree Experience with streaming media and video is beneficial Teamwork and communication skills are an important element to any position within Swank Motion Pictures.  The work environment in Swank Motion Pictures systems is team-based and fast paced.  Candidates must have excellent communication skills and should be able to collaborate with any member of the organization.  The candidate must present a professional attitude and demeanor and be able to adapt to the changing daily work environment. Benefits Comprehensive compensation and healthcare packages, including medical, dental, vision, and life insurance products 401(K) plan with employer match Competitive paid time off: vacation, personal time, holidays, and winter break Company sponsored volunteer & community outreach opportunities Organizational growth potential through our company sponsored online learning platform EOE, including disability and veterans
St. Louis, MO, USA
Negotiable Salary
Craigslist
Mill Operator- Surface Grinder/Form Grinder (Hernando)
Experience Required. ISO a highly skilled and reliable Mill Operator for Hurco CNC milling machines and/or expertise in surface grinding and form grinding to join our precision manufacturing team. This role requires experience working with steel to meet blueprint specifications and requires holding tight tolerances. This company manufactures precision cutting tools called broaches for the aerospace industry. Employees must have a strong mechanical background and take pride in craftsmanship. Candidate Skills: Operation of surface and form grinding machines to produce high-precision steel cutting tools Maintain close tolerances (within +/- .0005") consistently Set up and run Hurco CNC milling machines efficiently and accurately Interpret and follow engineering drawings, blueprints, and specifications Perform in-process inspection using precision measuring tools Maintain equipment, perform routine troubleshooting, and ensure a clean work area Collaborate with team members to meet production goals and quality standards Schedule: 10-hour shifts Monday-Friday Overtime and weekend availability as needed Compensation: Starting pay at $20.00/hour Benefits: Health insurance Dental insurance Vision insurance Life insurance Paid Time Off Requirements: 5+ years experience in machine surface grinding (not hand-held grinding) see photos Experience operating Hurco CNC milling machines High attention to detail and mechanical aptitude Ability to work 50-55 hours per week as needed High School Diploma or equivalent (preferred) Valid Driver's License (preferred) Preferred Experience: Familiarity with broach manufacturing and tooling Knowledge of G-code and CNC operation principles Please send your contact info (phone number or email) and/or resume
1196 E Overdrive Cir, Hernando, FL 34442, USA
$25-35/hour
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.