Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Senior Data Engineer
PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financial ecosystem. We are a boutique firm, where each person’s contributions and ideas are critical to the growth of the company.  This is a fully remote position, open to candidates anywhere in the U.S. with a reliable internet connection. While we gather in person a few times a year, this role is designed to remain remote long-term. You will have autonomy and flexibility in a flat corporate structure that gives you the opportunity for your direct input to be realized and put into action. You'll collaborate with a high-performing team — including sales, marketers, and financial services experts —  who stay connected through Slack, video calls, and regular team and company-wide meetings. We’re a team that knows how to work hard, have fun, and make a meaningful impact—both together and individually. Job Summary We are seeking a Senior Data Engineer to lead the design and implementation of scalable data pipelines that ingest and process data from a variety of external client systems. This role is critical in building the data infrastructure that powers Plum’s next-generation AI-driven products. You will work with a modern data stack including Python, Databricks, AWS, Delta Lake, and more. As a senior member of the team, you’ll take ownership of architectural decisions, system design, and production readiness—working with team members to ensure data is reliable, accessible, and impactful. Key Responsibilities Design and architect end-to-end data processing pipelines: ingestion, transformation, and delivery to the Delta Lakehouse. Integrate with external systems (e.g., CRMs, file systems, APIs) to automate ingestion of diverse data sources. Develop robust data workflows using Python and Databricks Workflows. Implement modular, maintainable ETL processes following SDLC best practices and Git-based version control. Contribute to the evolution of our Lakehouse architecture to support downstream analytics and machine learning use cases. Monitor, troubleshoot, and optimize data workflows in production. Collaborate with cross-functional teams to translate data needs into scalable solutions. Requirements Master’s degree in Computer Science, Engineering, Physics, or a related technical field or equivalent work experience. 3+ years of experience building and maintaining production-grade data pipelines. Proven expertise in Python and SQL for data engineering tasks. Strong understanding of lakehouse architecture and data modeling concepts. Experience working with Databricks, Delta Lake, and Apache Spark. Hands-on experience with AWS cloud infrastructure. Track record of integrating data from external systems, APIs, and databases. Strong problem-solving skills and ability to lead through ambiguity. Excellent communication and documentation habits. Preferred Qualifications Experience building data solutions in Fintech, Sales Tech, or Marketing Tech domains. Familiarity with CRM platforms (e.g., Salesforce, HubSpot) and CRM data models. Experience using ETL tools such as Fivetran or Airbyte. Understanding of data governance, security, and compliance best practices. Benefits A fast-paced, collaborative startup culture with high visibility. Autonomy, flexibility, and a flat corporate structure that gives you the opportunity for your direct input to be realized and put into action.  Opportunity to make a meaningful impact in building a company and culture.  Equity in a financial technology startup.  Generous health, dental, and vision coverage for employees and family members + 401K. Eleven paid holidays and unlimited discretionary vacation days. Competitive compensation and bonus potential.
San Francisco, CA, USA
Negotiable Salary
Craigslist
Software Engineer (redwood city)
NimbleRx, Inc. in Redwood City, California seeks a Software Engineer. Responsibility: Responsible for designing, building, and implementing software solutions to optimize and scale the Nimble platform and related technologies. Duties include: developing highly scalable software using innovative computer science and software engineering principles; creating product features and designing easy-to-use APIs, systems, and tools while ensuring proper protocols are in place to rapidly roll out upgrades and new features; developing a user-friendly interface using React, Java Spring, and PostgreSQL; building internal tools to support performance, reliability, and scalability; and other duties as assigned. Salary range $162,000 - $182,000. Eligible for standard benefits. Employee may be stationed anywhere within commuting distance of our Redwood City, CA office and will work in office 2 days per week. Education: Master’s degree in Computer Science, Software Engineering, or related field (or foreign equivalent). Requirements: 1 year of experience in the job offered or related. Other special requirements include: 1 year of experience working with Java, Ruby, Python, or similar programming languages; 1 year of experience developing API’s, services, and platform development; 1 year of experience developing user-facing applications using React, Flutter, or similar; and 1 year of experience working with distributed codebases on cross-functional teams. Please mail resumes to Attn: Eva Lee 2317 Broadway, Redwood City, CA 94063 quoting job #NIMSE25.
691 Winslow St, Redwood City, CA 94063, USA
$162,000-182,000/year
Workable
.Net Developer
*MUST be Local Metro Area Candidates* *US Citizenship or work-authorization with alien registration number required* *Onsite from Day 1* *1st Interview, Webcam & 2nd interview, In- Person* *First few weeks will be in the office Monday -Thursday to work with the current development staff to learn GSFC systems and business. Then after that, in the office 2/3 days a week depending on the Agency’s requirement at that time. ** Candidate MUST meet/exceed ALL required skills** Our Web Developer is responsible for development/maintenance of both current and future web applications written using the ASP.NET framework and ASP.NET Core with C# programming language. The ideal candidate is an enthusiastic, creative, highly motivated, and goal-oriented team player with at least 5 years of ASP.NET development experience with strong knowledge of OIDC & SAML based authentication.   Essential Duties and Responsibilities: •             Write clean, scalable code written using ASP.NET Core programming language, C#. •             Develop/maintain both current and future web applications. •             Work closely with the Client User Representatives to troubleshoot and design solutions that meet requirements. •             Accurately and effectively communicate with the Project Manager and/or Team Lead the level of effort to implement proposed solutions, the           status of on-going work, and any potential issues. •             Work well in both a team environment as well as a sole contributor with little or no supervision. •             Possess excellent time management skills in handling multiple priorities with individual deadlines. •             Adapt to a rapidly changing environment and work creatively with minimal supervision. •             Ability to work from written specifications and pre-established guidelines. •             Possess excellent written and oral communication skills. Education Qualifications: •             A bachelor’s degree in Computer Science, Information Systems, or a related scientific or technical degree; or equivalent experience. Masters Degree in Computer Science, Information Systems, or a related scientific or technical degree a plus     Technical Skills/Experience: Experience working with Identity server - OIDC & SAML based authentication. Experience working with .NET Core C#, n-tier architectures and design patterns. Minimum 5 years of experience in design, development and support of ASP.NET development focus on .NET MVC Core. Minimum 5 years of experience in complete life-cycle of design, development, deployment and support of web applications. Strong knowledge of Relational Databases and working with Oracle 11g, 12c databases, MS-SQL Solid HTML, JavaScript, jQuery, CSS, Bootstrap, .NET Framework 4+, .NET Core 8+, Razor Pages, MVC 5 Experience creating and consuming REST API Experience interfacing with customers and systems analysts to understand system requirements.   Additional Desired Skills/Requirements US Citizenship or work-authorization with alien registration number required. IIS, Docker Git version control Umbraco (ASP.NET Core CMS) Visual Studio 2022 Knowledge of ColdFusion, AngularJS ( version 1 ) is a plus
405 Stubbs Ave, Monroe, LA 71201, USA
Negotiable Salary
Craigslist
Apple Mac Support Tech LV2 (NYC / Onsite + Remote) (Midtown East)
Join DeepTech Inc. – Where Apple Expertise Meets Human Centered IT WHO WE ARE DeepTech Inc. is a trusted NYC-based MSP with 20+ years of delivering smart, personal, and proactive IT support. We’re a tight-knit team that values expertise, collaboration, and client success. Our environment is fast-paced, fun, and focused on real impact. Are you a macOS pro who loves problem solving and helping put a smile on clients face? We're looking for a full-time, Mac-focused IT Specialist to join our Service Desk team. This role combines in-office and onsite work, supporting clients across NYC. This role is for experienced professionals only—those who already know their way around macOS and the Apple ecosystem. If you're still learning the ropes, this one isn’t the right fit. Apple certifications are a big plus—but not required. WHAT YOU'LL DO Work from our bright Midtown NYC office and visit client sites throughout the city Handle a variety of technical support needs—from quick fixes to deeper troubleshooting Resolve tickets involving: > Password resets, printer setups, OS updates > Workstation migrations, server support, MDM configurations (e.g., JAMF, Mosyle, Intune) > macOS, Windows, Google Workspace, and O365 troubleshooting > Work with firewalls, switches, WiFi, VPN (SonicWall, Meraki) > Support VoIP systems, email security, spam filtering, and more > Participate in on-call rotation and team meetings > Keep documentation and client communication clear and up-to-date SKILLS & REQUIREMENTS > 4+ years supporting macOS, iOS, and mobile devices in professional environments > Familiarity with tools like Keychain, Activity Monitor, Console, LaunchAgents/Daemons > Experience with MDMs (JAMF, Mosyle, Intune, Meraki) > Comfort supporting Windows users at a Level 1 capacity > Hands-on experience with Google Workspace, Office 365, and cloud-based environments > Strong communication skills—you’re client-friendly, clear, and reliable > A self-starter mentality—you take ownership, but know when to escalate > Familiarity with ticketing systems (ConnectWise is a plus) and RMM tools WHAT WE OFFER + Compensation & Perks + Cell phone reimbursement + Commuter benefits + Medical, dental, vision, life, and AD&D insurance + 9 paid holidays, PTO, and sick time + Employee referral bonus and EAP access + Career Development * Clear annual training goals * Structured 3-week onboarding * Opportunity to work with Mac, PC, networking, and use all the fun tools * Friendly and supportive team culture * Midtown office with great energy * Monthly employee appreciation, and the occasional office pup * Breakfast team meetings and a culture that values your voice READY TO APPLY? If you're passionate about supporting Apple environments and want to thrive in a people-first MSP, we'd love to hear from you. Email your resume to us with the subject line: Mac Support Tech – YOUR FULL NAME WITH a pdf copy of your resume attached. Only candidates who follow this instruction will be considered. DeepTech Inc. is proud to be an Equal Opportunity Employer. We encourage applicants of all backgrounds and identities to apply.
209 West 38th St RM #1009, New York, NY 10018, USA
$75,000-92,000/year
Workable
Software Engineer, Skill Level 1
At Avalore, we are a mission-driven, veteran-owned small business that helps government agencies harness the power of data and emerging technologies to solve complex problems. Our team combines deep technical expertise with a passion for public service, delivering innovative, responsible solutions in AI, data governance, cybersecurity, and enterprise transformation. Joining Avalore means working alongside experts who have successfully led high-impact initiatives across the DoD and Intelligence Community, and being part of a company that values integrity, agility, and purpose. Your responsibilities will include: Develops, maintains, and enhances complex and diverse software systems (e.g., processing-intensive analytics, novel algorithm development, manipulation of extremely large data sets, real-time systems, and business management information systems) based upon documented requirements.  Analyze user requirements to derive software design and performance requirements  Design and code new software or modify existing software to add new features  Debug existing software and correct defects  Integrate existing software into new or modified systems or operating environments  Develop simple to complex data queries for existing or proposed databases or data repositories  Provide recommendations for improving documentation and software development process standards  Works individually or as part of a team.  Reviews and tests software components for adherence to the design requirements and documents test results.  Utilizes software development and software design methodologies appropriate to the development environment.  Provides specific input to the software components of system design to include hardware/software trade-offs, software reuse, use of Commercial Off-the-shelf (COTS)/Government Off-the-shelf (GOTS) in place of new development, and requirements analysis and synthesis from system level to individual software components. Requirements Bachelor’s degree in a technical discipline from an accredited college or university is required + Seven (7) years’ experience as a SWE in programs and contracts of similar scope, type, and complexity  Four (4) years of relevant SWE experience may be substituted for Bachelor’s Ability to work independently and manage multiple priorities. TS/SCI and Special Security Accesses and Polygraph required. Applicants must be currently authorized to work in the United States on a full-time basis. Avalore will not sponsor applicants for work visas for this position. Desired: Cloud, CNO, DevOps, Data Analytics, Machine Learning & AI  Benefits Eligibility requirements apply. Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k, IRA) Life Insurance (Basic, Voluntary & AD&D) Paid Time Off (Vacation, Sick & Public Holidays) Short Term & Long Term Disability Training & Development Employee Assistance Program
Fort Meade, MD, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.