Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Senior Software Engineer
Commify is on a mission to revolutionize business communications, and we are looking for an experienced Senior Software Engineer to join our passionate team. In this role, you will lead the development and enhancement of our cutting-edge messaging platform, ensuring it meets the evolving needs of businesses around the world. Your expertise will help shape our product vision, drive innovation, and create exceptional user experiences. As a Senior Software Engineer, you will collaborate closely with product managers, designers, and fellow engineers to deliver high-quality software solutions. We value creativity, critical thinking, and a proactive approach to problem-solving. If you have a strong technical background and want to work in a fast-paced environment, Commify is the perfect place for you. Requirements The Senior Software Engineer will:: Architect, design, develop, and deploy software solutions across our products. Engage in all phases of the software development lifecycle in an agile environment. Collaborate with cross functional teams to refine requirements into actionable tasks. Contribute to continuous improvement initiatives within the engineering team. Mentor junior developers and support overall team growth and learning. Drive adherence to best practices and coding standards. Ideal candidates will possess: Extensive experience in software development with modern programming languages. Strong foundation in C# .NET/.NET Core and Angular. Experience running production systems at scale in Microsoft Azure. Experience with CI/CD pipelines, Dev/Ops methodologies, and test automation. Experience with containerization technologies, such as Docker and Kubernetes Proven experience designing and building REST APIs. Experience with version control systems, especially GitHub. Understanding of agile methodologies and practices. Exposure to micro-SPA frontend application architecture. Excellent problem solving skills and attention to detail. Team oriented mindset with strong communication abilities. Ability to manage multiple priorities and meet deadlines. Preferred Qualifications: Experience in building and scaling multi-channel CPaaS/messaging platforms (SMS, MMS, RCS, WhatsApp, Voice, and Email). Experience working in a diverse, international team. Benefits Competitive Salary ($120,000 - 135,000) Company Bonus Enjoy the flexibility of remote work, complemented by regular off-site meetings scheduled in collaboration with your line manager. Healthcare & Dental. 20 days annual leave plus national holidays. Birthday off work, Wellbeing leave & Giving back days. Free access for you and your family to Calm, a mindfulness, health, and wellbeing App. 401k 4% employer contribution. Death in service (4x salary). Culture initiatives (Including Christmas rewards & monthly/quarterly social events). Training & Development opportunities with access to unlimited learning via Udemy.  
Chattanooga, TN, USA
$120,000-135,000/year
Workable
TIBCO Developer
Role: TIBCO Developer Location: Jackson MI -  Hybrid mode Position Type: Contract   We are seeking a TIBCO Developer to join the integration team supporting Consumers Energy in Jackson, MI. The ideal candidate will have strong expertise in TIBCO Business  Works 6.x and a solid understanding of enterprise integration patterns.   Responsibilities:   ·       Design, develop, and support integration solutions using TIBCO BusinessWorks 6.x and 5.x, TIBCO EMS, API development and TIBCO BusinessEvents. ·       Develop and maintain APIs using TIBCO API Exchange, including RESTful and SOAP web services ·       Configure and monitor messaging using TIBCO EMS, Hawk, and Rendezvous ·       Collaborate with business analysts, architects, and other developers to deliver high-quality integration solutions ·       Troubleshoot and resolve production issues in a timely manner ·       Participate in code reviews and deployment processes ·       Ensure integration components adhere to security, performance, and scalability standards   Required Qualifications:   ·       5+ years of hands-on experience with: ·       TIBCO BusinessWorks (BW) 6.x and 5.x ·       TIBCO EMS, Hawk, BusinessEvents ·       TIBCO Rendezvous and API Exchange Gateway ·       Solid understanding of SOA and integration architecture ·       Experience with RESTful and SOAP APIs ·       Familiarity with DevOps, CI/CD pipelines, and Git-based versioning ·       Strong debugging and troubleshooting skills in enterprise environments ·       Ability to work independently in a hybrid/remote setup ·       Strong verbal and written communication skills   Nice to Have:   ·       Knowledge of Containers (Docker/Kubernetes) and Cloud platforms (Azure or AWS) ·       Experience with other integration technologies or scripting languages ·       Prior experience working in utility or energy sectors   Note: they need BW and BE development skills, not just one or the other, can good comminication skills, clear english, I am also asking if they are willing to relocate to Jackson Mi, along with API development  
Jackson, MS, USA
Negotiable Salary
Craigslist
✅Remote Online Chat Support – $2,800/Week – No Experience Required!
💻 We're Hiring: Remote Chat Support – Earn Up to $2,800/Week Looking for a flexible, no-stress job you can do from home? Join our team as a Remote Chat Support Assistant and help customers via live chat. No phone calls, no sales—just simple text-based conversations. If you’re a fast typer with good communication skills, this is the perfect role. No previous experience needed! ✅ Weekly Pay – Earn up to $2,800/week ✅ Zero Sales or Phone Work – Text-only support ✅ Immediate Openings – Quick online training 👉 APPLY HERE TO GET STARTED 🔹 What the Role Involves: • Responding to customer questions via live chat • Offering basic support and troubleshooting • Recording and updating customer interactions • Following easy-to-understand chat guidelines 🔹 What You’ll Need: • A computer or laptop with internet access • Strong typing skills and clear written communication • Ability to work independently and stay on task • No experience? No problem—we provide full training 🔹 Why You’ll Love This Job: • Flexible hours – work part-time or full-time • Weekly pay – up to $2,800 per week • Fully remote – work in your PJs if you want • Ideal for students, stay-at-home parents, or anyone needing extra cash 🚀 Positions are limited and filling quickly. Start your remote job journey today! 📩 CLICK HERE TO APPLY NOW
395 Golden Gate Ave, San Francisco, CA 94102, USA
$2,800/month
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.