Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Software Engineer, Skill Level 2
At Avalore, we are a mission-driven, veteran-owned small business that helps government agencies harness the power of data and emerging technologies to solve complex problems. Our team combines deep technical expertise with a passion for public service, delivering innovative, responsible solutions in AI, data governance, cybersecurity, and enterprise transformation. Joining Avalore means working alongside experts who have successfully led high-impact initiatives across the DoD and Intelligence Community, and being part of a company that values integrity, agility, and purpose. Your responsibilities will include: Develops, maintains, and enhances complex and diverse software systems (e.g., processing-intensive analytics, novel algorithm development, manipulation of extremely large data sets, real-time systems, and business management information systems) based upon documented requirements.  Analyze user requirements to derive software design and performance requirements  Design and code new software or modify existing software to add new features  Debug existing software and correct defects  Integrate existing software into new or modified systems or operating environments  Develop simple to complex data queries for existing or proposed databases or data repositories  Provide recommendations for improving documentation and software development process standards  Works individually or as part of a team.  Reviews and tests software components for adherence to the design requirements and documents test results.  Utilizes software development and software design methodologies appropriate to the development environment.  Provides specific input to the software components of system design to include hardware/software trade-offs, software reuse, use of Commercial Off-the-shelf (COTS)/Government Off-the-shelf (GOTS) in place of new development, and requirements analysis and synthesis from system level to individual software components. Requirements Bachelor’s degree in a technical discipline from an accredited college or university is required + Fourteen (14) years’ experience as a SWE in programs and contracts of similar scope, type, and complexity  Four (4) years of relevant SWE experience may be substituted for the degree  Ability to work independently and manage multiple priorities. TS/SCI and Special Security Accesses and Polygraph required. Applicants must be currently authorized to work in the United States on a full-time basis. Avalore will not sponsor applicants for work visas for this position. Desired: Cloud, CNO, DevOps, Data Analytics, Machine Learning & AI  Benefits Eligibility requirements apply. Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k, IRA) Life Insurance (Basic, Voluntary & AD&D) Paid Time Off (Vacation, Sick & Public Holidays) Short Term & Long Term Disability Training & Development Employee Assistance Program
Fort Meade, MD, USA
Negotiable Salary
Workable
Full Stack Developer - Need Only Locals to GA
Job Description :   We are seeking a talented Full Stack Developer to join our team at iSoftTek Solutions Inc. As a Full Stack Developer, you will be responsible for designing, developing, and maintaining our web applications and software solutions. You will collaborate with cross-functional teams to deliver high-quality and scalable software products.   Responsibilities: Design, develop, and maintain web applications using modern technologies and frameworks Collaborate with product owners, designers, and other stakeholders to gather requirements and translate them into technical specifications Write clean and efficient code following industry best practices Perform code reviews for team members and provide constructive feedback Optimize application performance and ensure scalability Troubleshoot and debug issues reported by clients and users Stay up-to-date with the latest trends and technologies in web development   Requirements: Bachelor's degree in Computer Science, Software Engineering, or a related field Minimum of 3 years of experience as a Full Stack Developer Proficient in front-end technologies such as HTML, CSS, JavaScript, and JavaScript frameworks like React or Angular Strong knowledge of back-end technologies such as Java, Python, or Node.js Experience with databases such as MySQL or MongoDB Knowledge of version control systems like Git Excellent problem-solving and communication skills Ability to work independently and in a team environment Must be a local resident of Georgia, USA Requirements Requirement Summary: Bachelor's degree in Computer Science, Software Engineering, or related field 3+ years of experience as a Full Stack Developer Proficiency in HTML, CSS, JavaScript, and JavaScript frameworks (React, Angular) Strong knowledge of back-end technologies (Java, Python, Node.js) Experience with databases (MySQL, MongoDB) Knowledge of version control systems (Git) Excellent problem-solving and communication skills Ability to work independently and in a team environment Must be a local resident of Georgia, USA
Atlanta, GA, USA
Negotiable Salary
Craigslist
Class A Yard Driver - $24/hr (Bryan, TX)
NOW HIRING CLASS A YARD TRUCK DRIVERS!   Now Hiring Class A Yard Drivers - Bryan, Tx Class A Yard Hostler - Full-Time Pay: $24/hour Schedule: Sunday - Wednesday 6a - 6p 42hrs/week Description: We’re looking for a reliable Class A Yard Driver to join our team. You’ll be responsible for operating a Yard Goat, transporting loads around the yard, or a very short distance to another facility. This is a great opportunity for those looking for part time work who enjoy a steady, local job and working independently. Responsibilities: Safely operate a Class A Yard Hostler Commute short distances Perform pre- and post-trip vehicle inspections Maintain accurate logs and paperwork Interact professionally with warehouse staff and drivers  What We Offer: $24/hour 4 Days a week Supportive team environment Opportunities for advancement  Qualifications: Minimum 12 months of Class A experience within the last 2 years Satisfactory Employment Verifications for the past 3 years. Satisfactory Driving Record subject to TCI's Safety Insurance Criteria  Benefits & Perks: Weekly Pay with Direct Deposit Safety Incentives – Earn up to $1,200 extra per year Driver Referral Bonus Program Comprehensive Benefits Package – Medical, Dental & Vision Company-Paid Life and AD&D Insurance 401(k) with Company Match Earned Paid Time Off (PTO) Paid Holidays Employee Discounts through LifeMart4  About Us:  We are a family-owned company doing business since 1978. Our core values are the foundation of who we are as a team and how we do business. We are dedicated and committed to safety, each other, and our customers. Our team is positive and passionate and come to work each day with a “Can Do” attitude. We strive to be creative problem solvers who bring innovative thinking in all our work. Being ethical, transparent, and accountable has helped shape our team and how we do business. We are looking for more people that match our core values to join our team.
MGCC+C2 Bryan, TX, USA
$24/hour
Workable
Machine Learning Engineer, ML Runtime & Optimization
Founded in 2016 in Silicon Valley, Pony.ai has quickly become a global leader in autonomous mobility and is a pioneer in extending autonomous mobility technologies and services at a rapidly expanding footprint of sites around the world. Operating Robotaxi, Robotruck and Personally Owned Vehicles (POV) business units, Pony.ai is an industry leader in the commercialization of autonomous driving and is committed to developing the safest autonomous driving capabilities on a global scale. Pony.ai’s leading position has been recognized, with CNBC ranking Pony.ai #10 on its CNBC Disruptor list of the 50 most innovative and disruptive tech companies of 2022. In June 2023, Pony.ai was recognized on the XPRIZE and Bessemer Venture Partners inaugural “XB100” 2023 list of the world’s top 100 private deep tech companies, ranking #12 globally. As of August 2023, Pony.ai has accumulated nearly 21 million miles of autonomous driving globally. Pony.ai went public at NASDAQ in Nov. 2024. Responsibility The ML Infrastructure team at Pony.ai provides a set of tools to support and automate the lifecycle of the AI workflow, including model development, evaluation, optimization, deployment, and monitoring. As a Machine Learning Engineer in ML Runtime & Optimization, you will be developing technologies to accelerate the training and inferences of the AI models in autonomous driving systems. This includes: Identifying key applications for current and future autonomous driving problems and performing in-depth analysis and optimization to ensure the best possible performance on current and next-generation compute architectures. Collaborating closely with diverse groups in Pony.ai including both hardware and software to optimize and craft core parallel algorithms as well as to influence the next-generation compute platform architecture design and software infrastructure. Apply model optimization and efficient deep learning techniques to models and optimized ML operator libraries. Work across the entire ML framework/compiler stack (e.g.Torch, CUDA and TensorRT), and system-efficient deep learning models. Requirements BS/MS or Ph.D in computer science, electrical engineering or a related discipline. Strong programming skills in C/C++ or Python. Experience on model optimization, quantization or other efficient deep learning techniques Good understanding of hardware performance, regarding CPU or GPU execution model, threads, registers, cache, cost/performance trade-off, etc. Experience with profiling, benchmarking and validating performance for complex computing architectures. Experience in optimizing the utilization of compute resources, identifying and resolving compute and data flow bottlenecks. Strong communication skills and ability to work cross-functionally between software and hardware teams Preferred Qualifications: One or more of the following fields are preferred Experience with parallel programming, ideally CUDA, OpenCL or OpenACC. Experience in computer vision, machine learning and deep learning. Strong knowledge of software design, programming techniques and algorithms. Good knowledge of common deep learning frameworks and libraries. Deep knowledge on system performance, GPU optimization or ML compiler. Compensation and Benefits Base Salary Range: $140,000 - $250,000 Annually Compensation may vary outside of this range depending on many factors, including the candidate’s qualifications, skills, competencies, experience, and location. Base pay is one part of the Total Compensation and this role may be eligible for bonuses/incentives and restricted stock units. Also, we provide the following benefits to the eligible employees: Health Care Plan (Medical, Dental & Vision) Retirement Plan (Traditional and Roth 401k) Life Insurance (Basic, Voluntary & AD&D) Paid Time Off (Vacation & Public Holidays) Family Leave (Maternity, Paternity) Short Term & Long Term Disability Free Food & Snacks
Fremont, CA, USA
$140,000-250,000/year
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.