Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
C++ Market Data Engineer
Trexquant is a growing systematic fund at the forefront of quantitative finance, with a core team of highly accomplished researchers and engineers. To keep pace with our expanding global trading operations, we are seeking a C++ Market Data Engineer to design and build ultra-low-latency feed handlers for premier vendor feeds and major exchange multicast feeds. This is a high-impact role that sits at the heart of Trexquant's trading platform; the quality, speed, and reliability of your code directly influence every strategy we run. Responsibilities Design & implement high-performance feed handlers in modern C++ for equities, futures, and options across global venues (e.g., NYSE, CME, Refinitiv RTS, Bloomberg B-PIPE). Optimize for micro- and nanosecond latency using lock-free data structures, cache-friendly memory layouts, and kernel-bypass networking where appropriate. Build reusable libraries for message decoding, normalization, and publication to internal buses shared by research, simulation, and live trading systems. Collaborate with cross-functional teams to tune TCP/UDP multicast stacks, kernel parameters, and NIC settings for deterministic performance. Provide robust failover, gap-recovery, and replay mechanisms to guarantee data integrity under packet loss or venue outages. Instrument code paths with precision timestamping and performance metrics; drive continuous latency regression testing and capacity planning. Partner closely with quantitative researchers to understand downstream data requirements and to fine-tune delivery formats for both simulation and live trading. Produce clear architecture documents, operational run-books, and post-mortems; participate in a 24×7 follow-the-sun support rotation for mission-critical market-data services. Requirements BS/MS/PhD in Computer Science, Electrical Engineering, or related field. 3+ years of professional C++ (14,17,20) development experience focused on low-latency, high-throughput systems. Proven track record building or maintaining real-time market-data feeds (e.g., Refinitiv RTS/TREP, Bloomberg B-PIPE, OPRA, CME MDP, ITCH). Strong grasp of concurrency, lock-free algorithms, memory-model semantics, and compiler optimizations. Familiarity with serialization formats (FAST, SBE, Protocol Buffers) and time-series databases or in-memory caches. Comfort with scripting in Python for prototyping, testing, and ops automation. Excellent problem-solving skills, ownership mindset, and ability to thrive in a fast-paced trading environment. Familiarity with containerization (Docker/K8s) and public-cloud networking (AWS, GCP). Benefits Competitive salary, plus bonus based on individual and company performance. Collaborative, casual, and friendly work environment while solving the hardest problems in the financial markets. PPO Health, dental and vision insurance premiums fully covered for you and your dependents. Pre-Tax Commuter Benefits  Trexquant is an Equal Opportunity Employer
Stamford, CT, USA
Negotiable Salary
Workable
Senior Software Developer
Northstrat is seeking a senior developer with experience architecting and implementing technical solutions using modern software development practices and technologies. This is a new project with greenfield development! Your responsibilities will include architecting and implementing microservice solutions for complex problems and mentoring junior developers. You will write code using Test Driven Development that complies with our projects high code quality standards.  The ideal candidate leads by example and encourages a collaborative team-solutioning environment. This role demands a self-starter who can take vaguely defined tasks and works with the team to deliver high-quality solutions.  Java, Spring Framework, Spring Boot  Web frameworks – Angular, React, VUE  Databases - PostgreSQL, MySQL, MongoDB, Redis  Amazon Web Services (AWS) - EC2, Lambda, SNS, SQS, CloudFormation  Message Bus – RabbitMQ, ActiveMQ, Kafka  Automated testing tools - Mockito, JUnit, Cypress, Jest, etc.  Source code management tools - Git, GitLab, Bamboo  Containerization  and Deployment – Docker, Helm, Kubernetes  CI/CD DevSecOps pipeline tools - Jenkins, Git, Gitlab, Bamboo, BitBucket, SonarQube, Fortify  Issue and Ticket Tracking - Jira and Confluence    TypeScript  CSS  Groovy  Puppet  Requirements Must have an active TS/SCI with CI poly to qualify for this position Bachelor’s Degree in STEM field or related experience   Experience: 15+ years of relevant experience.  Must be available to work in-person in Sterling, VA or Aurora, CO   Strong Java skills, including JEE and REST web services.  Experience with Oracle, MySQL, or Postgres.  Proficiency in at least one modern programming language such as Java.  Proficiency with Linux development including command line  Experience with Java microservice application and interface design and development.  Understanding of Agile practices  Current Security+ (or similar) certification or willingness to obtain   Preferred Qualifications  Experience developing microservices using Spring Boot and the Spring Framework  Experience working with scalable and distributed message bus such as Apache Kafka  Experience applying DevOps best practices and leveraging tools such as Git, Jenkins, and Docker  Experience developing secure RESTful web services integrating Identity Management tools such as Keycloak and LDAP  Ability to work with container orchestration systems such as Kubernetes, Docker, and Helm  Knowledge of in-memory storage solutions (Redis) as well as AWS S3-compliant object stores  Experience applying DevOps best practices in day-to-day software development  Experience with Continuous Integration and Automated Testing using tools like Jenkins/Hudson, Cypress, JUnit, etc.  Knowledge of Java Instrumentation and Performance Monitoring.  Understanding of server virtualization using VMWare.  Web development skills in HTML5, JavaScript, Flash, JSP, GWT, or other frameworks.    Benefits Work/Life Balance Northstrat values true work life balance. We offer power of choice benefits designed to best meet the needs of you and your lifestyle. Our benefits programs are designed to support and encourage wellness, healthy living, retirement investment, and lifetime learning. Pay Range There are a host of factors that can influence final salary including, but not limited to, geographic location, Federal Government contract labor categories and contract wage rates, relevant prior work experience, specific skills and competencies, education, and certifications. We also offer competitive compensation, benefits, and professional development opportunities. Please refer to our Benefits section for additional details.   Flex Time Northstrat does not mandate specific working hours. Although project requirements may dictate schedules, a Northstrat employee is only required to work an average of 8 hours per weekday over the course of a month. For example: John worked 12 hours on June 1st to meet a project deadline. On June 15th, John only worked 4 hours because he left early for a long weekend. John’s IBA was not debited for time off because flex time allowed him to carry over those 4 hours from June 1st. Individual Benefits Account (IBA) To attract and retain the highest quality staff, Northstrat provides a unique and versatile benefits package, the Individual Benefit Account (IBA), which places the power of choice in the hands of our greatest asset – the employee. The purpose of the IBA is to provide attractive benefits to all full-time employees of Northstrat on a flexible basis that enables each covered employee to select a package that best suits his or her needs. Whether those needs are paid time off, medical expenses, prescription drug expenses, cash disbursement, or a combination of any of these, the IBA provides flexibility to help you meet your specific goals. The IBA can be used for such things as: IBA Benefits accrue each month in the amount equivalent to 50% of the employee’s monthly compensation rate. That is, the effective dollar amount of this accrual is in addition to an employee’s salary. Profit Sharing Plan (PSP) The PSP is a qualified retirement plan that Northstrat funds quarterly on the employee’s behalf through the IBA in the amount equivalent to 25% (up to the IRS contribution limit) of the employee’s compensation. That is, of the 50% accrual in the IBA, half of the amount accrued is applied to the PSP. Stock Options Because Northstrat is an employee-owned company, all new employees are offered stock options. Employees have the opportunity to receive additional stock options based on accomplishment of individual performance goals. Stock owners elect the Board of Directors and are directly impacted by the success of the company. Lifelong Learning Our culture promotes and nurtures a growth environment. We hire and scale rapidly to meet the needs of our partner customers. Through periodic company sponsored training events, and the ability to use IBA funds for reimbursement of work-related education expenses you will have the opportunity to continually grow your skills and abilities. Bring Your True Self We embrace diversity and encourage inclusion. We support employee led interest groups and challenge our employees to support others and be their best self. We are so true to our beliefs that we offer employee referral incentives. When you like it here, your friends and family will too! Northstrat is an Equal Opportunity Employer We are committed to fostering an inclusive, diverse workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, disability, veteran status or other legally protected status.
Sterling, VA, USA
Negotiable Salary
Workable
Angular Developer
Experience: 5 Years The Georgia Department of Human Services (DHS), Office of Information Technology (OIT), is seeking a qualified candidate for the temporary contractor staffing position of Angular Developer in Atlanta, Georgia. Angular Developer is responsible for building and maintaining dynamic web applications using the Angular framework and making sure the applications are ADA compliant. Responsibilities include the integration and design of new application systems and/or life-cycle enhancement to existing complex multi-platform (Java/.Net) Department of Human Services Systems. Responsible for determining the scope of the assigned project(s) by assessing requirements from business and technical/network personnel. Should develop complex features and UI components using Angular. Work with REST APIs, error handling and authentication. Work will include integration planning, analysis across multiple technical platforms across DHS to include both global system design and detailed program design for complex processes or interfaces, review of database design of new data structures, and suggested modifications to existing data structures. Effectively documents and teaches the structure and function of the new application and/or enhancements resulting from the assigned project(s) to other Web Application Managers and senior technical personnel to ensure that the new systems or enhancements operate smooth within DHS’s OIT environment. Qualifications: Bachelor’s degree in Computer Science or equivalent. 3 years of experience web development experience which includes the programming/ development of ADA compliance web applications. 3 years of Team lead experience is desirable to apply for the job. 3 years of experience with Java/J2EE, ASP .Net core. 3 years of experience of web development experience which includes the programming/ development of web applications. Experience with JSP (Java Server Pages), HTML, .Net, IIS Java Script, Java Servlets, XML, SQL, Oracle, Java/.Net Project Build & Deployment.  Experience leading large and small application development teams. Experience integrating applications and designing and developing web services and frameworks; extensive front and back-end experience required.
Atlanta, GA, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.