Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
.NET Application Developer
Department of Natural Resources (DNR) is seeking a highly motivated and experienced .NET Lead Application Developer to join DNR App Dev team. This role offers an opportunity to work in a mission-driven environment, supporting Iowa Drinking Water Data Portal and Water Allocation Compliance through a large portfolio of data collection and reporting applications. As a key member of our team, you'll be instrumental in driving our development initiatives and delivering secure, high-quality technical solutions to our customers. You will collaborate closely with teams to optimize development practices and automate pipelines that support large data volumes. This position requires attendance during standard business hours Monday through Friday, with initial on-site presence strongly preferred for orientation and team onboarding. As the .NET Lead Application Developer, you will: •    Have strong communications skills and the ability to work closely with a team. •    Have ability to read, understand, and create design documents. •    Have technical understanding of infrastructure components, their dependencies, and interactions between servers, virtual systems, networks,  databases, web applications, etc. •    Have ability to proactively participate in customer engagements, follow direction from team leads, work with customers, and participate in technical planning. •    Design and implement highly scalable DevOps processes to support the development and deployment of large-scale applications. •    Assess and improve coding and review practices, ensuring a high standard of code quality and security by integrating automated scanning tools into the development cycle. •    Proactively address technical debt before it escalates and ensure continuous improvement of development processes. •    Optimize processes around code branching, merging, and releases to facilitate seamless and efficient deployments.  •    Automate build and deployment processes, reducing manual effort and increasing operational efficiency. •    Enhance unit test and integration test coverage, ensuring application reliability and performance.
Des Moines, IA, USA
Negotiable Salary
Craigslist
Build a Career in Software Development 🧑‍💻
We are inviting dedicated individuals ready to pursue careers in technology. If you want to gain real coding experience, complete major projects, and prepare for junior developer jobs, this program is for you. This remote program provides nearly 900 hours of structured training and can be taken full-time or part-time. You will learn programming languages, developer tools, and workflows while building a résumé and portfolio for employers. 🖥️ Technology & Programming Fundamentals -Understand computer systems, networks, browsers, and internet functions -Study algorithms, data structures, security basics, and number systems -Practice Python scripting, command line tools, and flowchart design 💻 Web & Front-End Development -Build responsive websites with HTML5, CSS3, and Bootstrap -Create interactive apps using JavaScript, jQuery, and React.js -Practice modern web design and layout techniques 🗄️ Back-End & Database Development -Design and manage databases with SQL and SQL Server -Perform CRUD operations and relational database modeling -Build scalable applications with Python (Django) and C# (.NET Core) 🧑‍💻 Programming Languages & Tools -Learn C#, Python, JavaScript, HTML, CSS, SQL, and more -Use Git, GitHub, Visual Studio, and Team Foundation Server -Apply professional coding collaboration and version control 🧪 Capstone Projects -Complete two advanced projects (Python + C#) -Build portfolio-ready applications using Agile, Scrum, and DevOps -Practice debugging, teamwork, and problem-solving skills 🧰 Career Preparation -Learn résumé and cover letter writing for the tech industry -Practice coding interviews and whiteboard techniques -Prepare for entry-level developer opportunities 🚀 No prior training necessary. Remote-friendly program. Begin your journey as a developer today. 👉 Apply here: https://softwaredevpros.online/
2901 Andorra Ct, Parkville, MD 21234, USA
$30/hour
Workable
Java Full Stack Developer
Sr. Full Stack Developer, Dallas TX (Local) with 10+ Years experience Must go for Face to Face Interview Minimum Experience Strong coding skills and concepts in Java Java EE Technologies, Spring Framework, Micro services Architecture, Service Oriented Architecture (SOA), JDBC, JNDI, JTA/JTS, JMS Rich Internet Applications (RIA) - React/AngularJS, JavaScript /jQuery/CSS/HTML5 Web Servers & Application Servers IBM WebSphere/Tomcat/tcServer Integration & Collaboration Tools Subversion, GIT Web Services WSDL, SOAP, JAX-WS, XML RPC, JAXB, RESTWS Java Database Frameworks - Hibernate, Java Persistence API (JPA) Relational databases and SQL like Oracle RDBMS or SQL Server. NoSQL databases like MongoDB, CouchDB or CosmosDB Messaging Layer – RabbitMQ, IBM MQ Proficiency and demonstrated experience in Cloud-based development (Azure preferred) Experience in Agile methodologies, such as SCRUM Experience in DevOps Toolchain methodologies, including Continuous Integration and Continuous Deployment Proficiency in Full Stack Development Experience working with Angular 8 years of full Software Development Life Cycle (SDLC) experience 8 years of Java experience with demonstrated experience in Java EE Technologies, Spring Framework, Java Database Frameworks, Micro services Architecture, Rich Internet Applications, Web Servers & Application Servers IBM WebSphere/Tomcat/tcServer, Web Services, Relational/SQL/NO SQL databases, and Messaging Layer Proficiency and demonstrated experience in Cloud-based development (Azure preferred) Experience in DevOps Toolchain methodologies, including Continuous Integration and Continuous Deployment Experience in Agile methodologies, such as SCRUM
Dallas, TX, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.