Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Angular Developer Designer
Description: Role Name: Angular Developer / Designer Location: US-NYC / FIFTHAVE / Hybrid - New York, NY Who We’re Looking For: We seek self-starters who thrive in fast-paced environments and tackle challenges with intellectual curiosity and a proactive mindset. Candidates must be adaptable, collaborative, and accountable, consistently delivering top-quality results while acting with integrity. Job Functions / Duties & Responsibilities Front-End Design & Development Design and develop front-end applications using Angular 9+, RxJS, TypeScript, HTML, CSS, and JavaScript Deliver impactful UI components that shape user experiences Requirements & Stakeholder Engagement Work with senior technology and business stakeholders to gather requirements and guide design decisions Implement features for complex workflows, including validation, approvals, and dashboards Innovation & Problem-Solving Develop innovative solutions to meet business needs, enhancing enterprise applications with middleware or custom RESTful services Agile & DevOps Collaboration Participate in Agile ceremonies; contribute to CI/CD pipelines for automated builds and deployments Engage in all SDLC phases—analysis, design, coding, testing, and implementation Quality Assurance & Support Apply DevOps practices to maintain code quality and reliability Proactively identify and resolve front-end issues, offering production support when needed Required Skills Angular Expertise 7–10 years of front-end development using Angular 9+ (ReactJS as a bonus), RxJS, and TypeScript Front-End Proficiency Skilled in JavaScript, HTML, CSS, AJAX, and responsive design Integration & Web Services Experience with SOAP/REST/SSL and enterprise data flows SDLC & Agile Methodologies Proficiency in Agile frameworks (Scrum/Kanban), DevOps (CI/CD), and tools like JIRA Teamwork & Communication Excellent communication and presentation skills; comfortable collaborating with diverse teams in a fast-paced environment
New York, NY, USA
Negotiable Salary
Craigslist
Entry Level Source Testers Needed (hayward / castro valley)
We are a nationally recognized. West Coast Specialty Source (Stack) Testing firm looking for a few exceptional people to fill part time positions out of our Hayward, California office. Projects will include training. Mechanical ability, ambition and being a fast, efficient learner could potentially lead to a permanent role. We operate on the entire West Coast but are specifically looking for personnel local to our office willing to commute, learn and be a solid part of our team. Stack testing is a very sought after trade. And if you push to prove yourself, I can guarantee you a position almost anywhere in the country after putting in your time and effort with me. What is stack testing anyway? Stack testing represents an analytical procedure to measure air pollutants emitted to the atmosphere or in regulatory terms: measuring the emissions from an emission point. There are different methods to analyze the emissions from a stack. EPA has published numerous technical methods for stack testing. These highly detailed methods coupled with analytical and sampling hardware and specifically trained stack testing specialists can produce quality emission information. When is a stack test required? The most common reasons for conducting a stack test include: • Satisfying regulatory compliance requirements • Developing site specific or categorical emission factors • Engineering development, and • Guarantee verification The position will start as Part time, up to 30 hours a week and include training, mentorship and instruction on sites. The ideal candidates are technically minded, team players with understanding of mechanics, working at height, safety and most importantly, integrity. If you are seeking an entry level environmental technician job that could turn into more. We are the path, join us.
24176 Clarendale St, Hayward, CA 94544, USA
$20-25/hour
Workable
Senior Data Engineer
PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financial ecosystem. We are a boutique firm, where each person’s contributions and ideas are critical to the growth of the company.  This is a fully remote position, open to candidates anywhere in the U.S. with a reliable internet connection. While we gather in person a few times a year, this role is designed to remain remote long-term. You will have autonomy and flexibility in a flat corporate structure that gives you the opportunity for your direct input to be realized and put into action. You'll collaborate with a high-performing team — including sales, marketers, and financial services experts —  who stay connected through Slack, video calls, and regular team and company-wide meetings. We’re a team that knows how to work hard, have fun, and make a meaningful impact—both together and individually. Job Summary We are seeking a Senior Data Engineer to lead the design and implementation of scalable data pipelines that ingest and process data from a variety of external client systems. This role is critical in building the data infrastructure that powers Plum’s next-generation AI-driven products. You will work with a modern data stack including Python, Databricks, AWS, Delta Lake, and more. As a senior member of the team, you’ll take ownership of architectural decisions, system design, and production readiness—working with team members to ensure data is reliable, accessible, and impactful. Key Responsibilities Design and architect end-to-end data processing pipelines: ingestion, transformation, and delivery to the Delta Lakehouse. Integrate with external systems (e.g., CRMs, file systems, APIs) to automate ingestion of diverse data sources. Develop robust data workflows using Python and Databricks Workflows. Implement modular, maintainable ETL processes following SDLC best practices and Git-based version control. Contribute to the evolution of our Lakehouse architecture to support downstream analytics and machine learning use cases. Monitor, troubleshoot, and optimize data workflows in production. Collaborate with cross-functional teams to translate data needs into scalable solutions. Requirements Master’s degree in Computer Science, Engineering, Physics, or a related technical field or equivalent work experience. 3+ years of experience building and maintaining production-grade data pipelines. Proven expertise in Python and SQL for data engineering tasks. Strong understanding of lakehouse architecture and data modeling concepts. Experience working with Databricks, Delta Lake, and Apache Spark. Hands-on experience with AWS cloud infrastructure. Track record of integrating data from external systems, APIs, and databases. Strong problem-solving skills and ability to lead through ambiguity. Excellent communication and documentation habits. Preferred Qualifications Experience building data solutions in Fintech, Sales Tech, or Marketing Tech domains. Familiarity with CRM platforms (e.g., Salesforce, HubSpot) and CRM data models. Experience using ETL tools such as Fivetran or Airbyte. Understanding of data governance, security, and compliance best practices. Benefits A fast-paced, collaborative startup culture with high visibility. Autonomy, flexibility, and a flat corporate structure that gives you the opportunity for your direct input to be realized and put into action.  Opportunity to make a meaningful impact in building a company and culture.  Equity in a financial technology startup.  Generous health, dental, and vision coverage for employees and family members + 401K. Eleven paid holidays and unlimited discretionary vacation days. Competitive compensation and bonus potential.
San Francisco, CA, USA
Negotiable Salary
Craigslist
A/V Field Technician Position
AV Technicians Wanted Positions Available: Full-Time Part-Time Experience: Minimum of 2 years in A/V preferred. About Us: Unify Productions, located in Deerfield Beach since 2004, specializes in audio and video integration in the commercial and hospitality idustries. We are looking for both experienced A/V Technicians and entry-level A/V Pre-Wire Technicians to join our dynamic team. Compensation will be determined based on experience. Our projects mainly involve high-end commercial venues, including restaurants, lounges, nightclubs, country clubs, and retail spaces. Key Responsibilities: Low voltage pre-wiring for audio, video, and data networks in both pre-construction and post-construction settings. Terminate Cat 6 cables and punch down blocks. Install equipment such as speakers, TVs, amplifiers, projectors, network access points, and security cameras. Assemble A/V and data equipment racks. Test and verify the functionality of installed systems. Troubleshoot and resolve technical service issues. Qualifications: Ability to thrive in a fast-paced environment. Self-motivated with a strong work ethic and attention to detail. Team player who collaborates well with others. Professional demeanor and appearance in line with company standards. Proficient with hand and power tools. A/V certifications are a plus but not required! How to Apply: If you’re interested, please send your resume in response to this posting, or feel free to call our office with any questions. We look forward to hearing from you!
1011 Lyndhurst H, Deerfield Beach, FL 33442, USA
$20/hour
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.