Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
LDAP Software Engineer - Peru, IN -Fulltime Role
LDAP Software Engineer Location: Peru, IN Duration: Permanent role Responsibilities: * Work with upstream data source and downstream clients to resolve data related issues. * Assist in designing, developing, and implementing Data as A Service (DaaS) and support for microservices. * Perform data and log analysis. * Assist in designing, developing, and implementing flexible LDAP architecture for PaaS and SaaS applications. * Performance periodic maintenance as/when required. Requirements: * Performance periodic maintenance as/when required. * Assist in designing, developing, and implementing flexible LDAP architecture for PaaS and SaaS applications. * Work with upstream data source and downstream clients to resolve data related issues. * Assist in designing, developing, and implementing Data as A Service (DaaS) and support for microservices. * Perform data and log analysis. * Advanced knowledge of LDAP directories based on OpenDJ, Oracle (sun) or ForgeRock directories. * Expert in maintaining, troubleshooting issues in production environment. * Experience in installing and configuring Oracle DSEE 11g & OpenDJ, ForgeRock DS. Required Software Skills: * Directory Services (LDAP, MS Active Directory, MS Entra ID), including Group Policy, DNS, and DHCP Exchange / M365 * VMware vSphere/vCenter * Server and PC operating systems including Windows OS's and Linux * Citrix DaaS, and related components * Microsoft SQL Server and/or Oracle SQL along with database management utilities Recommended Working Knowledge * PowerShell * Git (GitHub / Gitlab) * TCP/IP * Networking OSI mode
Indiana, Peru
Negotiable Salary
Craigslist
Website Tester - Join Fast
APPLY HERE Join our team of website testers at Little Wheel. We are a gambling technology company researching and building products that put players first. We are hiring Website Testers at all of our offices across North America. Earn at least $1,000 for around 20 hours of testing. You’ll earn a minimum of $25/hour, but faster testers earn more. This is a short-term contract. There are opportunities for ongoing work for high performers. It’s ideally suited to people looking to supplement their income. You will not be gambling with your money, and you do not need any experience. There are no fees or out-of-pocket expenses. You'll complete a short online training program before starting to ensure you have the right skills for the role. We offer a $100 bonus for completing onboarding with us, so you start earning straight away. What's in it for you: Easy money - you will earn at least $1,000 for around 20 hours of testing. Work from home - earn from the comfort of your own home. Flexible schedule - you can choose when you work, day or night. Paid quickly - the testing is split into 4 stages, and you get paid after each. Great support - our research coordinators are available from 6am to 11pm ET. What you need to get started: Be at least 21 years old. Have your own laptop or desktop. What team members say about us: Great side gig for some extra cash. The team is very communicative and will answer any questions/concerns! (Maria, Trustpilot, 2021) Tasks to complete are clearly explained with step by step instructions. There are timelines to complete tasks but you can work on them when convenient for you, usually a few hours each week is all you need. Support is very helpful and responsive. This is an easy and fun way to make some extra money. (Anonymous, Glassdoor, 2025) APPLY NOW
6J8W+JP Romulus, MI, USA
$25/hour
Workable
Senior Software Developer
Northstrat is seeking a senior developer with experience architecting and implementing technical solutions using modern software development practices and technologies. This is a new project with greenfield development! Your responsibilities will include architecting and implementing microservice solutions for complex problems and mentoring junior developers. You will write code using Test Driven Development that complies with our projects high code quality standards.  The ideal candidate leads by example and encourages a collaborative team-solutioning environment. This role demands a self-starter who can take vaguely defined tasks and works with the team to deliver high-quality solutions.  Java, Spring Framework, Spring Boot  Web frameworks – Angular, React, VUE  Databases - PostgreSQL, MySQL, MongoDB, Redis  Amazon Web Services (AWS) - EC2, Lambda, SNS, SQS, CloudFormation  Message Bus – RabbitMQ, ActiveMQ, Kafka  Automated testing tools - Mockito, JUnit, Cypress, Jest, etc.  Source code management tools - Git, GitLab, Bamboo  Containerization  and Deployment – Docker, Helm, Kubernetes  CI/CD DevSecOps pipeline tools - Jenkins, Git, Gitlab, Bamboo, BitBucket, SonarQube, Fortify  Issue and Ticket Tracking - Jira and Confluence    TypeScript  CSS  Groovy  Puppet  Requirements Must have an active TS/SCI with CI poly to qualify for this position Bachelor’s Degree in STEM field or related experience   Experience: 15+ years of relevant experience.  Must be available to work in-person in Sterling, VA or Aurora, CO   Strong Java skills, including JEE and REST web services.  Experience with Oracle, MySQL, or Postgres.  Proficiency in at least one modern programming language such as Java.  Proficiency with Linux development including command line  Experience with Java microservice application and interface design and development.  Understanding of Agile practices  Current Security+ (or similar) certification or willingness to obtain   Preferred Qualifications  Experience developing microservices using Spring Boot and the Spring Framework  Experience working with scalable and distributed message bus such as Apache Kafka  Experience applying DevOps best practices and leveraging tools such as Git, Jenkins, and Docker  Experience developing secure RESTful web services integrating Identity Management tools such as Keycloak and LDAP  Ability to work with container orchestration systems such as Kubernetes, Docker, and Helm  Knowledge of in-memory storage solutions (Redis) as well as AWS S3-compliant object stores  Experience applying DevOps best practices in day-to-day software development  Experience with Continuous Integration and Automated Testing using tools like Jenkins/Hudson, Cypress, JUnit, etc.  Knowledge of Java Instrumentation and Performance Monitoring.  Understanding of server virtualization using VMWare.  Web development skills in HTML5, JavaScript, Flash, JSP, GWT, or other frameworks.    Benefits Work/Life Balance Northstrat values true work life balance. We offer power of choice benefits designed to best meet the needs of you and your lifestyle. Our benefits programs are designed to support and encourage wellness, healthy living, retirement investment, and lifetime learning. Pay Range There are a host of factors that can influence final salary including, but not limited to, geographic location, Federal Government contract labor categories and contract wage rates, relevant prior work experience, specific skills and competencies, education, and certifications. We also offer competitive compensation, benefits, and professional development opportunities. Please refer to our Benefits section for additional details.   Flex Time Northstrat does not mandate specific working hours. Although project requirements may dictate schedules, a Northstrat employee is only required to work an average of 8 hours per weekday over the course of a month. For example: John worked 12 hours on June 1st to meet a project deadline. On June 15th, John only worked 4 hours because he left early for a long weekend. John’s IBA was not debited for time off because flex time allowed him to carry over those 4 hours from June 1st. Individual Benefits Account (IBA) To attract and retain the highest quality staff, Northstrat provides a unique and versatile benefits package, the Individual Benefit Account (IBA), which places the power of choice in the hands of our greatest asset – the employee. The purpose of the IBA is to provide attractive benefits to all full-time employees of Northstrat on a flexible basis that enables each covered employee to select a package that best suits his or her needs. Whether those needs are paid time off, medical expenses, prescription drug expenses, cash disbursement, or a combination of any of these, the IBA provides flexibility to help you meet your specific goals. The IBA can be used for such things as: IBA Benefits accrue each month in the amount equivalent to 50% of the employee’s monthly compensation rate. That is, the effective dollar amount of this accrual is in addition to an employee’s salary. Profit Sharing Plan (PSP) The PSP is a qualified retirement plan that Northstrat funds quarterly on the employee’s behalf through the IBA in the amount equivalent to 25% (up to the IRS contribution limit) of the employee’s compensation. That is, of the 50% accrual in the IBA, half of the amount accrued is applied to the PSP. Stock Options Because Northstrat is an employee-owned company, all new employees are offered stock options. Employees have the opportunity to receive additional stock options based on accomplishment of individual performance goals. Stock owners elect the Board of Directors and are directly impacted by the success of the company. Lifelong Learning Our culture promotes and nurtures a growth environment. We hire and scale rapidly to meet the needs of our partner customers. Through periodic company sponsored training events, and the ability to use IBA funds for reimbursement of work-related education expenses you will have the opportunity to continually grow your skills and abilities. Bring Your True Self We embrace diversity and encourage inclusion. We support employee led interest groups and challenge our employees to support others and be their best self. We are so true to our beliefs that we offer employee referral incentives. When you like it here, your friends and family will too! Northstrat is an Equal Opportunity Employer We are committed to fostering an inclusive, diverse workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, disability, veteran status or other legally protected status.
Sterling, VA, USA
Negotiable Salary
Workable
Data Engineer - Job ID: DE2025
Build the data foundation that powers patient‑centric decisions Ascendis Pharma is a growth‑stage biopharmaceutical company guided by the core values Patients · Science · Passion. To strengthen our cloud‑native commercial and medical data platform, we are looking for a Data Engineer who combines solid data‑pipeline craftsmanship with a collaborative, product‑oriented mindset. You will join the same agile product team as our analysts, working in rapid product‑discovery cycles to deliver trustworthy data that drives access to life‑changing therapies. Your four focus areas 1. Data Engineering Design, build and maintain scalable ELT pipelines that ingest Patient Support Program, Specialty Pharmacy, Claims, CRM, Marketing, Medical and Financial data. Implement automated data‑quality checks, monitoring and alerting. 2. Data Modelling Develop canonical data models and dimensional marts in our up-coming Databricks Lakehouse to enable self‑service analytics. Apply best‑practice naming, documentation and version control. 3. Collaboration & Facilitation Work side‑by‑side with analysts and product owners to translate business questions into robust technical solutions. Lead whiteboard sessions and spike explorations during product discovery. 4. DevOps & Continuous Improvement Configure CI/CD pipelines for data code, automate testing and promote reusable patterns. Keep an eye on performance, cost and security, driving iterative enhancements. Key responsibilities Engineer reliable, end‑to‑end data flows using Spark SQL and Pyspark notebooks in Databricks (nice to have). Orchestrate and schedule batch & streaming jobs in Azure Data Factory or similar tools. Develop and maintain dbt models (nice to have) to standardise transformations and documentation. Implement data‑cataloguing, lineage and governance practices that meet pharma‑compliance requirements. Drive alignment with analysts to optimise queries, refine schemas and ensure metrics are consistent across dashboards to ensure stakeholders have a single source of truth for decision-making Contribute to agile ceremonies (backlog refinement, sprint reviews, retros) and actively champion a culture of data craftsmanship. Why Ascendis Mission that matters – Our pipelines accelerate insight generation that expands patient access to vital therapies. Modern stack – Azure, Databricks, dbt, GitHub Actions – with room to propose new tools. End‑to‑end ownership – Influence everything from ingestion to visualisation in a small, empowered team. Hybrid flexibility & growth – Work three days onsite, enjoy generous benefits, great snacks and pursue clear technical or leadership paths. Requirements What you bring Experience – 3–7 years in Data Engineering or Analytics Engineering, ideally in pharma, biotech or another regulated, data‑rich environment. Core toolkit – Advanced SQL and Python. Solid experience in dimensional modelling. Nice‑to‑have – Hands‑on with Databricks notebooks/Lakehouse and dbt for transformation & testing. Product mindset – Comfortable iterating fast, demoing early and measuring impact. Communication & teamwork – Able to explain trade‑offs, write clear documentation and collaborate closely with analysts, product managers and business and other stakeholders. Quality focus – Passion for clean, maintainable code, automated testing and robust data governance. Benefits 401(k) plan with company match Medical, dental, and vision plans Company-offered Life and Accidental Death & Dismemberment (AD&D) insurance Company-provided short and long-term disability benefits Unique offerings of Pet Insurance and Legal Insurance Employee Assistance Program Employee Discounts Professional Development Health Saving Account (HSA) Flexible Spending Accounts Various incentive compensation plans Accident, Critical Illness, and Hospital Indemnity Insurance   Mental Health resources Paid leave benefits for new parents A note to recruiters: We do not allow external search party solicitation.  Presentation of candidates without written permission from the Ascendis Pharma Inc Human Resources team (specifically from: Talent Acquisition Partner or Human Resources Director) is not allowed.  If this occurs your ownership of these candidates will not be acknowledged.
Princeton, NJ, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.