Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Freelance Software Developer (Python Engineer) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role We are looking for an experienced Python developer who enjoys building tools, environments, and infrastructure for working with LLM-based agents. You’ll help create sandboxes, task systems, and CI/CD pipelines to support testing and development of AI agents. You’ll also work closely with researchers and domain experts, helping them set up and use these tools effectively. Although every project is unique, you might typically: Sandboxes for running and testing AI agents safely Tools for writing tasks and test cases for agents CI/CD pipelines to run checks and evaluate agents Dev environments for experts creating these tasks Repo templates and scripts to help new contributors Interfaces for tracking task input and agent results Example Tasks How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have 5+ years of experience writing Python code. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
Texas, USA
$50
Craigslist
Launch Your Career in Software Development 🧑‍💻
We are seeking motivated learners who are eager to launch careers in technology. If you want to develop coding expertise, complete professional projects, and prepare for junior developer positions, this pathway is for you. This remote training program can be done part-time or full-time, with nearly 900 hours of guided coursework and projects. You’ll gain hands-on experience with top programming languages, developer tools, and workflows—all while building a strong résumé and portfolio. 🖥️ Technology & Programming Fundamentals -Learn computer, network, browser, and internet basics -Study algorithms, number systems, data structures, and security essentials -Practice Python scripting, command line usage, and flowchart design 💻 Web & Front-End Development -Build functional websites with HTML5, CSS3, and Bootstrap -Develop interactive features using JavaScript, jQuery, and React.js -Apply responsive design techniques and best practices 🗄️ Back-End & Database Development -Design and query databases with SQL and SQL Server -Perform CRUD tasks and understand relational models -Build back-end systems with Python (Django) and C# (.NET Framework/Core) 🧑‍💻 Programming Languages & Tools -Learn C#, Python, JavaScript, HTML, CSS, SQL, and more -Work with Git, GitHub, Visual Studio, and Team Foundation Server -Practice industry-standard collaboration and version control 🧪 Capstone Projects -Complete two large projects (Python + C#) that demonstrate your skills -Build portfolio-ready work with Agile, Scrum, and DevOps processes -Develop strengths in debugging, problem-solving, and teamwork 🧰 Career Preparation -Write résumés and cover letters tailored for tech -Practice technical interviews and whiteboard challenges -Prepare for entry-level roles in software and web development 🚀 No experience required. Remote options available. Begin your career in technology today. 👉 Apply here: https://softwaredevpros.online/
1732 Elmore Ave, Columbus, OH 43224, USA
$30/hour
Workable
Data Engineer III
Position: Data Engineer III    Location: Redmond, WA 98052    Duration: 12 Months       Job Type: Contract         Work Type:  Onsite      Job Description:     Responsibilities  Build statistical models to identify patterns and trends in production testing data (telemetry, time-series) to generate correlation and predictions.  Develop an understanding of the manufacturing execution system with its multiple sources of data and relationship. Analyze the production system data and derive insights into current bottlenecks and areas of improvement, along with specific actionable recommendations  Collect, format and report periodic snapshots of the production and test data for consumption by other program managers and engineers.  Synthesize analysis and communicate insights and recommendations to various audiences  Work closely with technical program managers and engineers to provide data insights that help explain anecdotes from the manufacturing floor, and provide actionable resolution steps  Create templates and scripts to help scale and automate our ability to ingest, analyze and enable quick data reviews.  Required Skills & Experience  7+ years of related experience (data science, data engineering, data analysis, ML engineering)  4+ years of data querying languages (e.g. SQL), scripting languages (e.g. Python) or statistical/mathematical software (e.g. R, SAS, Matlab, Minitab, etc.) experience  2+ years of machine learning/statistical modeling data analysis tools and techniques, and parameters that affect their performance experience  Very Strong development experience with notable BI reporting tools (Oracle BI Enterprise Edition (OBIEE)).  Should have experience developing complex and a variety of reports.  A good candidate has strong analytical skills and enjoys working with large complex data sets.  Experience applying theoretical models in an applied environment  A good candidate can partner with business owners directly to understand their requirements and provide data which can help them observe patterns and spot anomalies. Preferred  Experience in Python, Perl, or another scripting language  Master's degree in a quantitative field such as statistics, mathematics, data science, engineering, or computer science  Experience in aerospace, manufacturing, test processes and/or test systems development  Typical Day in the Role:    Daily Schedule:   Accelerate test data collection and reviews to help reduce testing requirements across the OISL LRUs  Simplify and automate (with scripts and standard schemas) the continuous collection and formatting of such data  Develop dashboards and visualizations to help the test triage process  Develop a continuous monitoring and alarming framework that can help inform Engineers of areas needing a deeper analysis  Partner with the continuous improvement and OISL teams to accelerate the creation of analysis and tooling to establish manufacturing statistical process controls of key LRUs and test processes  Candidate Requirements:    REQUIRED SKILLS  Years of Experience: 5 years  Leadership Principle:   Customer Obsession, Learn and Be Curious, Dive Deep, Clear communication  Top 3 must-have hard skills  5+ years of related experience (data science, data engineering, data analysis, ML engineering)  scripting languages (e.g. Python  Statistical modeling data analysis tools   
Redmond, WA, USA
Negotiable Salary
Workable
Senior Business Applications Admin
Job Title: Senior Business Applications Administrator The Elevator Pitch Are you passionate about optimizing business systems and driving operational excellence? Evolv is seeking a Senior Business Applications Administrator to lead the administration of NetSuite and other key enterprise applications. This role is ideal for someone who thrives in a fast-paced public company environment and is excited to partner with cross-functional teams to deliver scalable, compliant solutions. Evolv is a fast-growing company, and it is essential that our IT and CyberSecurity program can deliver scalable, secure solutions that enable growth while not disrupting innovation.  Success in the Role: What are the performance outcomes over the first 6-12 months you will work toward completing? In the first 30 days, you will: Get to know the IT team along with the technologies currently in use Build relationships with key stakeholders, such as finance and accounting Learn the compliance commitments and how best to support these efforts Take on responsibility for application administration and evaluation Familiarize yourself with the IT team’s procedures and the applications they currently support Gain a deep understanding of Evolv's NetSuite configuration and integrations Meet with stakeholders to understand current workflows and pain points Review existing SOX controls and identify areas for improvement Within 3 months, you will: Join our top-tier implementation program and collaborate with industry leaders to deliver a best-in-class solution to Evolv as we transform our back office Develop trust-based relationships to understand the business’s goals Evaluate the business needs for improved integrations and data processes Have built relationships with the finance and accounting teams and continue to find ways to help action administrative tasks when they arise Have a general understanding of what each team does across the organization, and develop a sense of whom you can go to when more information is needed Have built a presence in the office as a familiar, reliable face ready to help where needed Own the NetSuite environment, including user access, workflows, customizations, and reporting Begin managing additional applications such as Workday, Salesforce, and PO management systems Implement technical changes based on business requests, ensuring alignment with compliance and operational goals   By the end of the first year, you will: Own the NetSuite environment, including user access, workflows, customizations, and reporting Deliver high-quality IT services that continue to enable Evolv’s growth and success Understand and fulfill the businesses’ needs for applications and quality data Identify improvements to our existing applications and how they are used Continuous compliance with SOX (Sarbanes-Oxley), managing additional applications such as Workday, PO Management, and other systems. Implement technical changes based on business requests, ensuring alignment with compliance and operational goals. The Work: What type of work will you be doing? What assignments, requirements, or skills will you be performing on a regular basis? Serve as the primary administrator for NetSuite, including configuration, maintenance, and support. Manage additional business applications typical for a public company, such as Workday, PO management systems, and other applications Translate business requirements into technical solutions, including scripting, workflows, and integrations Maintain and enhance SOX controls across all relevant systems Build relationships with our users to best identify where our supported application may be falling short, recommend potential enhancements, and improve the effective use of existing applications Document procedures and teach the Evolv employees and staff how to utilize our applications for best practices Implementing business solutions which deliver iterative improvements in consultation with the business, technology, and other operational support teams Lead system upgrades, testing, and documentation efforts Provide training and support to end users What is the leadership like for this role? What is the structure and culture of the team? You will be joining the Cybersecurity and IT organization as a direct report of the Sr Director of Business Applications and Data Evolv and this team are cross-functional with a focus on reducing risk and improving the use of technology throughout the organization. This is a small, tight-knit team in a fun, fast-paced environment with a constant focus on change and incremental improvement. The team culture is one based on building trust, collaboration, and ongoing development through kindness, authenticity, courage, drive, and fun! Where is the role located? This role is based out of the HQ in Waltham, Massachusetts, with flexibility to be remote 1-2 days a week as business requirements allow. Compensation and Transparency Statement  The base salary range for this full-time position is $92,000- $148,000. In addition to base salary, this role offers a competitive target bonus, equity, and a comprehensive benefits package. This range reflects our commitment to pay transparency and equity, in alignment with applicable state laws. Our compensation ranges are determined based on factors such as role, level, location, market benchmarks, and internal equity. The posted range represents the good-faith estimate of what we expect to pay for this role across U.S. locations. Actual compensation within the range will be based on the candidate’s skills, experience, education, and geographic location.   In accordance with state and local pay transparency laws—including those in California, Colorado, Massachusetts, New York, New Jersey, and others—we disclose salary ranges in all job postings and provide additional information upon request.   During the hiring process, your recruiter will share:   The specific salary range for your preferred location   A general overview of our benefits and equity offerings   Insights into how compensation decisions are made, including factors that influence starting pay   We are committed to fair pay practices, and we regularly review our compensation programs to ensure they are competitive, equitable, and aligned with our values.  Benefits At Evolv, we’re on a mission to help make public spaces safer through innovative security technology. So, we're looking for future teammates who embody our values, people who:    Do the right thing, always;    Put people first'    Own it;    Win together; and continue to     Be bold, stay curious.        Our Benefits Include:    Equity as part of your total compensation package    Medical, dental, and vision insurance    Flexible Spending Accounts (FSA)    A 401(k) plan (and 2% company match)    Flexible Paid Time Off (PTO)- take the time you need to recharge, with manager approval and business needs in mind   Quarterly stipend for perks and benefits that matter most to you    Tuition reimbursement to support your ongoing learning and development    Subscription to Calm    Evolv Technology (“Evolv”) is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind. We welcome and encourage diversity in the workplace, and all employment decisions are made without regard to race, color, religion, national, social or ethnic origin, sex (including pregnancy), age, disability, HIV Status, sexual orientation, gender identity and/or expression, veteran status, or any other status protected by law in the locations where we operate. Evolv will not tolerate discrimination or harassment based on any of these characteristics.   Evolv is committed to offering an inclusive and accessible experience for all job seekers, including individuals with disabilities. If you need a reasonable accommodation as part of the job application process, please connect with us at careers@evolvtechnology.com.   Evolv participates in E-verify for all employees after the completion of Form I-9.
Waltham, MA, USA
$92,000-148,000/year
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.