Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
.NET Application Developer
Department of Natural Resources (DNR) is seeking a highly motivated and experienced .NET Lead Application Developer to join DNR App Dev team. This role offers an opportunity to work in a mission-driven environment, supporting Iowa Drinking Water Data Portal and Water Allocation Compliance through a large portfolio of data collection and reporting applications. As a key member of our team, you'll be instrumental in driving our development initiatives and delivering secure, high-quality technical solutions to our customers. You will collaborate closely with teams to optimize development practices and automate pipelines that support large data volumes. This position requires attendance during standard business hours Monday through Friday, with initial on-site presence strongly preferred for orientation and team onboarding. As the .NET Lead Application Developer, you will: •    Have strong communications skills and the ability to work closely with a team. •    Have ability to read, understand, and create design documents. •    Have technical understanding of infrastructure components, their dependencies, and interactions between servers, virtual systems, networks,  databases, web applications, etc. •    Have ability to proactively participate in customer engagements, follow direction from team leads, work with customers, and participate in technical planning. •    Design and implement highly scalable DevOps processes to support the development and deployment of large-scale applications. •    Assess and improve coding and review practices, ensuring a high standard of code quality and security by integrating automated scanning tools into the development cycle. •    Proactively address technical debt before it escalates and ensure continuous improvement of development processes. •    Optimize processes around code branching, merging, and releases to facilitate seamless and efficient deployments.  •    Automate build and deployment processes, reducing manual effort and increasing operational efficiency. •    Enhance unit test and integration test coverage, ensuring application reliability and performance.
Des Moines, IA, USA
Negotiable Salary
Craigslist
Lab Tech
Job Title: Laboratory Technician for Agricultural Soils Location: Santa Paula Job Type: Full-Time Salary: $16.50 - $17.50 per hour Job Description: We are seeking a motivated and detail-oriented Agricultural Soils Laboratory Technician to join our team for an entry-level position . In this hands-on role, you will support soil testing and analysis to ensure accurate and reliable results for agricultural applications. This position offers a great opportunity for individuals with an interest in agricultural science and laboratory work. Key Responsibilities: Sample Preparation: Prepare and process soil samples for laboratory analysis, ensuring all samples are properly labeled and documented. Chemist Support: Assist chemists and laboratory staff with the preparation of various soil analyses. Additional Tasks: Assist with other laboratory-related duties and tasks as assigned, which may include data entry and general lab clean-up. Physical Requirements: Ability to lift up to 50lbs as part of daily responsibilities. Qualifications: High school diploma or equivalent. Background in agriculture, chemistry, or a related field is preferred but not required. Strong attention to detail and ability to follow established procedures. Excellent organizational and time-management skills. Ability to work independently and as part of a team in a fast-paced environment. Benefits: Competitive hourly wage: $16.50 – $17.50 Full-time position with health, dental, vision, and 401K.
321 E Santa Paula St, Santa Paula, CA 93060, USA
$16-17/hour
Workable
Senior Software Engineer
This Software Engineering position is with NoGood's sister company, Goodie AI. Read on to learn more. About Goodie AI: Goodie AI is the pioneering LLM visibility and AI search optimization platform enabling the world’s top brands to own their AI narrative across leading LLMs like ChatGPT, Gemini and Perplexity. Backed by strong funding and validated by active paying customers, we are scaling fast and tackling some of the hardest AI search challenges. We are looking for an exceptional Senior Software Engineer to join our rapidly growing team. You will play a critical role in driving and accelerating the development of cutting-edge AI use cases, working closely with our Product Lead, Designers, and Machine Learning Engineers to design and build scalable, industry-leading AI platforms. After you apply, check out Goodie AI's website to learn even more! Why join us: Shape the future of AI search and brand discovery—work at the cutting edge of Answer Engine Optimization (AEO). End-to-end ownership—drive scalability, speed, and user experience of our AI-Native platform. Work on high-impact AI applications used by top brands. Well-funded, fast-growing AI startup with a strong product-market fit. Salary: $160K-$200K + Equity (commensurate with experience). Location: NYC-based (In-person). Best-in-class benefits. You'll do: Lead the development of our AI platform, focusing on scalability, speed, and user experience. Architect and develop front-end solutions using React to create smooth, engaging, and intentional user experiences. Implement back-end infrastructure with a focus on speed, scalability, security, and seamless integration with various platforms via robust API connections. Utilize DevOps practices to manage the deployment pipeline, ensuring efficient, reliable, and secure software delivery. Collaborate with UX/UI Designers to translate web designs into functional, intuitive user interfaces. Work closely with Data Scientists to ensure accurate data collection, analysis, and application within the platform. Participate in the entire application lifecycle, from coding to debugging and testing, with an emphasis on quality and performance. Maintain and optimize the performance of existing applications. Stay up-to-date with emerging technologies and explore potential integrations to enhance our operations. Take full ownership of the technical delivery of projects from planning through deployment. Translate business requirements into technical specifications and ensure alignment across engineering and product teams. Develop project timelines, allocate resources, and monitor progress to ensure timely delivery of features and milestones. Anticipate risks and roadblocks, proactively manage dependencies, and resolve issues to keep projects on track. Ensure quality assurance, performance, and scalability standards are met throughout the development lifecycle. You have: 5+ years of full-stack development experience building high-usage B2B applications. Frontend expertise in React, TypeScript, and Next.js, with a focus on responsive, high-performance interfaces. Experience with server-side languages such as Python, Node.js, or Java. Strong understanding of DevOps practices, including CI/CD, containerization (Docker), and cloud infrastructure (AWS, GCP, or Azure). Experience with database management systems (MySQL, PostgreSQL, MongoDB). Solid knowledge of RESTful APIs, API integration, and data exchange formats (JSON, XML). Familiarity with version control (Git), automated testing, and software development best practices. Bonus: Experience with AI search, vector databases, LLM APIs, embeddings, or retrieval-augmented generation (RAG). Startup-ready: thrives in fast-paced, ambiguous environments, loves shipping quickly. Passion for ad tech, AI, and building AI-native engineering teams. BSc in Computer Science, Engineering, or a relevant field. What We Offer: Benefits & Perks of Becoming a Goodie: Earn More, Together: Base Pay + Profit Sharing & Commissions Opportunities Health First: Premium Medical, Dental & Vision Coverage Flex Work Environment: hybrid at HQ and remote globally Set Up Shop: Home Office Stipend Recharge Anytime: Unlimited PTO Plan Family First: Paid Parental Leave Plan Secure Your Future: 401(k) Plan with Employer Matching Level Up: Mentorship & Career Growth Support Always Be Learning: Access to Top-tier Resources & Industry Experts Work Hard, Play Harder: Quarterly Team Trips (Onsite and Offsite) Mind & Body Wellness: Gym, Wellness, and Access to Mental Health Plans Fuel Your Day: Free Lunch, Snacks, Cold Brew, & Happy Hours Grow With Us: Endless Opportunities to Lead & Succeed Keep on Shining: Ongoing Employee Development Programs EEO & Compensation Transparency: Goodie AI is committed to pay transparency and equity among all employees and provides employees an environment where pay transparency and dialogue on compensation are allowed. Goodie AI complies with federal, state, and local laws on compensation, pay transparency, and pay equity. We take factors including geographic location, education, training, skillset, market rates, certifications, and more into consideration when constructing pay ranges for new and existing roles within our organization. The compensation range for this position is $160,000 - $200,000, base pay plus bonus. At Goodie AI, we understand that diversity in the workplace is vital to a company’s success and growth. We strive to make sure that our team members are included and have a sense of belonging that makes us a great company to work with and a great company to work for. To that end, Goodie AI is committed to Equal Opportunity Employment and complies with all Equal Opportunity Employment laws. We will consider all qualified applicants without regard to race, religion, color, national origin, sex, gender identity, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will work to make reasonable accommodations available in the job application and interview process, to perform essential duties of the job function, and to retrieve other benefits and privileges of employment with our organization.  BEWARE OF FRAUD! Please be aware of potentially fraudulent job postings or suspicious activity by persons that are posing as NoGood team members, recruiters, and HR employees. Our team will contact you regarding job opportunities from email addresses ending in @nogood.io or @higoodie.com. Additionally, we do utilize our ATS- Workable- to help us schedule initial screening calls. Job seeking is hard- we’re sorry that scammers have added this element to your search for something new. Stay vigilant out there!
New York, NY, USA
$160,000-200,000/year
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.