Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
API Kong Engineer
API Kong Engineer Location: Phoenix, AZ (Hybrid – 3-5 days/week from office) Duration: 12 months Experience:8+Years   Job Description: We are seeking a skilled API Developer / Integration Engineer who is proficient in managing and optimizing APIs using KONG Gateway. As part of our team, you will be responsible for designing, developing, and deploying API solutions that enhance our platform’s functionality and performance. Responsibilities: Design and implement scalable API solutions using KONG Gateway. Collaborate with cross-functional teams to gather and understand integration requirements. Develop custom plugins and middleware to extend KONG Gateway functionalities. Optimize API performance and security through monitoring, tuning, and troubleshooting. Implement API management best practices including versioning, documentation, and access control. Integrate APIs with various backend systems and databases. Ensure high availability and reliability of APIs by implementing robust failover and redundancy strategies. Stay updated with the latest industry trends and advancements in API management and integration. Requirements: Proven experience in designing and developing APIs using KONG Gateway. Strong understanding of RESTful API design principles and best practices. Proficiency in programming languages such as Python, Node.js, or Java. Experience with containerization technologies like Docker and orchestration tools such as Kubernetes. Familiarity with API security standards (OAuth, JWT, SSL/TLS). Ability to troubleshoot complex API issues and performance bottlenecks. Excellent communication skills and the ability to collaborate effectively with team members. Proven experience as a Kong API expert or similar role. Strong knowledge of API design and development principles. Proficiency in Kong API gateway configuration and management. Experience with Kong plugins, Lua, and Kong Enterprise features. Familiarity with RESTful APIs, OAuth, JWT, and other API security protocols. Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus. Strong troubleshooting and problem-solving skills.   Preferred Skills: Experience with other API gateways (e.g., Apigee, AWS API Gateway) is an advantage. Knowledge of cloud platforms (e.g., AWS, Azure, GCP).Experience with DevOps practices and CI/CD pipelines. Familiarity with logging and monitoring tools (e.g., ELK stack, Prometheus). Preferred Qualifications: KONG Certified Developer or Administrator. Experience with other API gateways and management platforms. Knowledge of microservices architecture and design patterns.  
Phoenix, AZ, USA
Negotiable Salary
Workable
Full Stack Developer - McLean, VA
Title: Full-stack Software Developer Location: McLean, VA Rate: $Open/ Hr 2+ year contract Openings: 4 Description:- • Master’s or Minor in Computer Science • 5 years of experience developing front end technologies: Angular JS, Node JS, JavaScript, Typescript, HTML 5, or CSS • Experience with Protractor, Karma, or Jasmine • Experience in Application Development using one of modern languages: Java, JEE, Spring, Go, or Lua • Experience in one of Cloud technologies: AWS, Azure, OpenStack, Docker, Ansible, Chef or Terraform • Experience developing RESTful APIs, developing UNIX and Shell Scripts • Experience in Testing frameworks and Quality Assurance technologies: ATDD, Selenium, Cucumber, JUnit, and SoapUI • Experience in Container orchestration frameworks: Kubernetes, Docker Swarm, or Amazon ECS • Experience with Artifactory, Nexus and GitHub • Certified in Java, Spring or AWS technologies. Note: If interested please send your updated resume to Gowri.Sankar@two95intl.com and include your Rate requirement along with your contact details with a suitable time when we can reach you. If you know of anyone in your sphere of contacts, who would be a perfect match for this job then, we would appreciate if you can forward this posting to them with a copy to us. We look forward to hearing from you at the earliest! Requirements Note: If interested please send your updated resume to Gowri.Sankar@two95intl.com and include your Rate requirement along with your contact details with a suitable time when we can reach you. If you know of anyone in your sphere of contacts, who would be a perfect match for this job then, we would appreciate if you can forward this posting to them with a copy to us. We look forward to hearing from you at the earliest!
McLean, VA, USA
Negotiable Salary
Workable
Technical Support Engineer
Engineer Solutions that Empower Students  Are you passionate about technology, troubleshooting, and making an impact in education? MasteryPrep is seeking a Technical Support Engineer to provide high-quality support to both internal teams and external users, ensuring seamless operations across our technology platforms. Join a team dedicated to using technology to empower educators and students nationwide. In this role, you will serve as a key technical resource for our customers, troubleshooting and resolving complex issues across full-stack web applications. You’ll use modern developer tools, databases, and reporting systems to diagnose problems, ensure smooth integrations, and deliver timely solutions. This hands-on position involves collaborating closely with development, QA, and product teams to reproduce and resolve defects, maintaining application stability, and driving continuous improvement. Success in this role requires both strong technical expertise and clear, empathetic communication, ensuring that every customer interaction leads to a reliable and positive experience. Key Responsibilities: Serve as the primary point of escalation for customers issues, addressing their technical inquiries and issues related to full-stack technologies. Provide timely troubleshooting and resolution of customer-reported bugs in web applications built with TypeScript and React. Diagnose and resolve database-related issues in PostgresSQL and Firestore, ensuring data integrity and performance optimization. Document, track, and escalate customer-reported bugs using Gitlab. Collaborate with development teams to reproduce, diagnose, and resolve software defects Lead maintenance engineering. Work closely with cross-functional teams, including development, QA, and product management, to resolve complex technical issues. Communicate effectively with customers, providing updates on the status of their requests and issues in a clear and timely manner. Gather feedback from customers to improve the support process and contribute to product enhancements. About MasteryPrep Nearly 90% of low-income students graduate high school without a college-ready ACT or SAT score. MasteryPrep’s mission is to level the playing field in education by offering the most effective test preparation available – made accessible to all students.  Through more than 10 successful years of partnering with school districts and institutions on college readiness services and resources, MasteryPrep has surpassed one million students served since the company’s founding in 2012.  MasteryPrep increased its student outreach by 70 percent in 2021 and is ranked among the Inc. 5000 “Fastest Growing Companies,” featured by “Entrepreneur 360,” and selected among the “Growth Leaders” by Louisiana Economic Development. Requirements Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience) 2+ years experience as a full-stack engineer Strong knowledge of Google Firestore, PostgreSQL, TypeScript, JaveScript, and React Experience with SSO,  specifically with Security Assertion Markup Language (SAML) protocols Proficient in integrating Learning Tools Interoperability (LTI) standards  Skilled in integrating with Student Information Systems (SIS)  Familiarity with rostering and integration services in education technology (e.g., Clever, ClassLink, Schoology) Excellent problem-solving and troubleshooting skills Ability to work independently and as part of a team in a fast-paced environment Strong communication and collaboration skills Familiarity with compliance standards such as FERPA, COPPA or PCI DSS preferred Knowledge of secure coding practices and application security testing techniques preferred Benefits $75,000-$85,000 starting salary based on qualifications  Opportunity to work with cutting-edge technologies in a collaborative environment Flexible work hours and remote work environment Professional development opportunities and reimbursement for certifications and training  Company-sponsored social events and team-building activities Employee benefits eligibility (health, disability, AD&D, life insurance) Matching 401k Paid time off Generous paid holidays
West Roxbury, Boston, MA, USA
$75,000/year
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.