Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Desktop User Experience Service Delivery Manager
Ensure consistent, reliable, and efficient cybersecurity service delivery within a technical domain Ensure high-quality service and drive continuous improvement through standardized management practices, measuring team efficiency, and fostering ongoing team development Act as the primary point of contact for leadership regarding the performance of IT and cybersecurity service delivery in design, transition, deployment, and operational support Demonstrate strong leadership, interpersonal, and management skills along with a solid understanding of technology services within the Desktop User Experience technical domain Oversee the end-to-end delivery of IT service quality within the Desktop User Experience domain Monitor, manage, enhance and report on IT service performance against agreed SLAs, and KPIs Foster a culture of continuous improvement and knowledge sharing within the team. Ensure the team has the necessary skills and resources to deliver excellent service Oversee the resolution of major incidents and problems impacting service delivery Coordinate internal IT teams to drive root cause analysis, After Action reports, and remediation solutions Understand, evangelize, and enforce service delivery lifecycle principles envisioning, design, plan, stabilize and deploy phases Collaborate with the Change Management team to ensure changes to IT services are implemented in the most effective and efficient manner, and with minimal disruption to the business Identify opportunities for service improvement and drive initiatives to enhance service quality, efficiency, and cost-effectiveness Provide regular reports on IT service performance to senior management and business stakeholders Manage relationships with key IT vendors, ensuring they deliver services according to agreed contracts and SLAs Contribute to the development and management of the IT service delivery budget. Track and control service delivery costs Maintain awareness of the financial health of assigned projects, including budget management, forecasting, and variance analysis Oversee and actively participate in operations maintenance and sustainment activities Optimize the allocation and utilization of operational resources, identifying opportunities to improve efficiency and reduce costs Other duties as assigned Requirements Education/Training:  Bachelor’s Degree in relevant engineering or science discipline required Master’s Degree preferred Must have, or obtain within 6 months of start date, current DoD 8570 or 8410 compliant certifications (i.e. Security+) ITIL v4 Foundation Certification preferred Relevant Technical Certifications (Azure Administrator Associate, AWS, etc.) preferred Experience: 12+ years of professional experience in the required task area  5+ years of professional experience as an IT Service Delivery Manager or similar role 1+ years of professional experience working in a management or leadership role Experience, knowledge of, or exposure to delivering and/or managing IT Service Delivery within several large and complex organizations across government and commercial environments In-depth understanding of ITIL framework and best practices, including incident management, problem management, change management, and service release management Experience with service management tools (e.g., ServiceNow, BMC Remedy) Working knowledge and understanding of the following technical areas: Microsoft 365 (M365) Email and Collaboration Virtual Desktop Infrastructure (VDI) and Azure Virtual Desktop (AVD Windows Client Operating Systems Desktop Management Client-side Application Management Mobile Device Management (MDM File & Print Services Security: Must be a US citizen Candidate must be in possession of a minimum DoD issued Secret Clearance and eligibility for TS/SCI Candidates with active current TS/SCI preferred Physical Requirements: Able to occasionally reach with hands and arms Prolonged periods of computer screen use, while sitting or standing at a desk Adhere to safety protocols when in work areas requiring use of PPE (e.g. eyewear, gloves, masks, hearing protection, steel toed shoes, etc.) Able to safely lift and carry up to 20 pounds at a time Benefits Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k, IRA) Life Insurance (Basic, Voluntary & AD&D) Paid Time Off (Vacation, Sick & Public Holidays) Short Term & Long Term Disability Training & Development Wellness Resources Salary: $150,000.00 - 180,000.00 Salary rates for this position are competitive and commensurate with experience and industry standards. We offer a comprehensive benefits package that may include health insurance, paid time off, and retirement savings options.
Colorado Springs, CO, USA
$150,000-180,000/year
Craigslist
Enroll in the Software Boot Camp Online Today and Land a Tech Job
The Tech Academy delivers cost-effective and self-paced online coding boot camps that are tailored for beginners with no prior technical or coding knowledge. Our certification programs thoroughly cover in-demand skills for the tech industry, are endorsed by stellar online reviews and designed to fit around your personal schedule to prepare you for your tech career with a well-rounded tool kit. We have been offering thorough, budget-friendly, flexible, and trusted coding boot camps for over a decade. Founded in 2014, The Tech Academy specializes in certifying students in a wide range of technical specialties, including: AI, coding, cybersecurity, data science, app development, design, web development, and more. After your coding boot camp, our job placement specialists will provide you with career guidance. Our team has successfully placed over 1,000 graduates in technical positions, with most making an average of more than $30/hour in their first job after graduation. Here is an overview of The Tech Academy's certification programs: 1. FLEXIBLE SCHEDULING & SELF-PACED TRAINING 2. BEGINNER-FRIENDLY COURSES 3. WELL-ROUNDED & THOROUGH TRAINING 4. AFFORDABLE & BUDGET-FRIENDLY TUITION 5. OVER 1,000 5-STAR REVIEWS ONLINE 6. JOB PLACEMENT TRAINING & ASSISTANCE The Tech Academy’s online certification programs start at $5,980, with multiple tuition financing options available. Start your journey into the technology industry today with one of our award-winning online coding boot camps! Find out more here by contacting us here: https://thetechacademy.us Your dream job in tech is just a Tech Academy boot camp away!
J36J+4X Honalo, HI, USA
$30/hour
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.