Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Project Management Office Director
Job Title: Project Management Office Director The Elevator Pitch Are you ready to build and lead a high-impact PMO from the ground up? Evolv is seeking a Director of PMO to formalize project intake, drive organizational alignment, and establish scalable project management practices from IT and across the company. This is a unique opportunity to shape how projects are prioritized, resourced, and executed in a fast-paced, mission-driven public technology company. Success in the Role: What are the performance outcomes over the first 6-12 months you will work toward completing? In the first 30 days, you will: Assess current project management practices and identify gaps in intake, tracking, and reporting Meet with department heads to understand their project needs and priorities Begin drafting a framework for standardized project intake and approval Build relationships with key stakeholders, from Executive Leadership to department heads Gain a deep understanding of Evolv's current projects and initiatives Meet with stakeholders to understand current workflows and pain points Within 3 months, you will: Develop trust-based relationships to understand the business’s goals Meet with Executive Leadership to understand priorities and share recommendations Have built relationships with the finance and accounting teams and continue to find ways to help action administrative tasks when they arise Have a general understanding of what each team does across the organization, and develop a sense of whom you can go to when more information is needed Have built a presence in the company as a familiar, reliable face ready to help where needed Launch a formalized project intake process that includes clear criteria for prioritization and resource commitment Establish a centralized tracking system for project status, timelines, and dependencies Build relationships with functional leaders to ensure alignment and buy-in By the end of the first year, you will: Lead a fully operational PMO that supports cross-functional visibility and accountability Deliver executive-level reporting on project health, resource utilization, and strategic alignment Be recognized as a trusted advisor for project governance and execution Continuously refine PMO processes to support scalability and agility. The Work: What type of work will you be doing? What assignments, requirements, or skills will you be performing on a regular basis? Design and implement a company-wide project intake and prioritization framework Build and manage a centralized project tracking system with dashboards and reporting tools Facilitate regular portfolio reviews and executive update Develop templates, playbooks, and best practices for project execution Mentor and support project managers across departments Drive continuous improvement in project delivery and organizational alignment What is the leadership like for this role? What is the structure and culture of the team? You will be joining the Cybersecurity and IT organization as a direct report to the VP of Cybersecurity and IT. Evolv and this team are cross-functional with a focus on reducing risk and improving the use of technology throughout the organization. Where is the role located? Our headquarters is in Waltham, MA. While this role involves traveling to HQ up to 8 days each month to collaborate with the team, we welcome exceptional candidates located remotely across the United States. Compensation and Transparency Statement  The base salary range for this full-time position is $138,000- $222,000. In addition to base salary, this role offers a competitive target bonus, equity, and a comprehensive benefits package. This range reflects our commitment to pay transparency and equity, in alignment with applicable state laws. Our compensation ranges are determined based on factors such as role, level, location, market benchmarks, and internal equity. The posted range represents the good-faith estimate of what we expect to pay for this role across U.S. locations. Actual compensation within the range will be based on the candidate’s skills, experience, education, and geographic location.   In accordance with state and local pay transparency laws—including those in California, Colorado, Massachusetts, New York, New Jersey, and others—we disclose salary ranges in all job postings and provide additional information upon request.   During the hiring process, your recruiter will share:   The specific salary range for your preferred location   A general overview of our benefits and equity offerings   Insights into how compensation decisions are made, including factors that influence starting pay   We are committed to fair pay practices, and we regularly review our compensation programs to ensure they are competitive, equitable, and aligned with our values.    Benefits At Evolv, we’re on a mission to help make public spaces safer through innovative security technology. So, we're looking for future teammates who embody our values, people who:    Do the right thing, always;    Put people first'    Own it;    Win together; and continue to     Be bold, stay curious.        Our Benefits Include:    Equity as part of your total compensation package    Medical, dental, and vision insurance    Flexible Spending Accounts (FSA)    A 401(k) plan (and 2% company match)    Flexible Paid Time Off (PTO)- take the time you need to recharge, with manager approval and business needs in mind   Quarterly stipend for perks and benefits that matter most to you    Tuition reimbursement to support your ongoing learning and development    Subscription to Calm    Evolv Technology (“Evolv”) is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind. We welcome and encourage diversity in the workplace, and all employment decisions are made without regard to race, color, religion, national, social or ethnic origin, sex (including pregnancy), age, disability, HIV Status, sexual orientation, gender identity and/or expression, veteran status, or any other status protected by law in the locations where we operate. Evolv will not tolerate discrimination or harassment based on any of these characteristics.   Evolv is committed to offering an inclusive and accessible experience for all job seekers, including individuals with disabilities. If you need a reasonable accommodation as part of the job application process, please connect with us at careers@evolvtechnology.com.  
Waltham, MA, USA
$138,000-222,000/year
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.