Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Software Engineer with Clearance
What is Aviture? Aviture is a full-service technology consulting firm with expertise in software solutions for both commercial and government organizations. We believe software doesn’t mean anything unless it solves a problem, so we create technology to enable users, open possibilities, and create meaningful impact. “I wanted to create a company that I would have wanted to work at when I was an engineer.” — Mark Griffis, President We are headquartered in Omaha, Nebraska, with remote employees across the nation: Las Vegas, Washington D.C., Austin, Dallas, Portland, Green Bay, Kansas City, Madison, Minneapolis, and Orlando, just to name a few. What is Aviture’s Art of the Possible? Along with our mission-driven team’s deep expertise in a wide range of development languages, we employ a disciplined agile approach to define goals upfront, keep organizational value at the forefront, and set the pace for rapid, iterative innovation that transforms organizations. We call this the Art of the Possible. The solutions we’ve created have: Saved lives in the California wildfires and southern U.S. flooding Provided security for the 2020 Presidential Inauguration, Super Bowl, and post-attack Boston Marathon Enabled augmented-reality training environments for surgeons Increased transparency and promoted patient wellness in hospitals and senior care facilities Combined computer vision and robotics to automate dangerous manual labor tasks And much more! Why You’ll Want to Live Aviturian Aviturians create technology that makes a meaningful difference in someone’s life. We’re a team made up of designers, engineers, developers, and inventors who believe technology’s purpose is to empower users to change the world. Here are the values that guide us: Embody integrity Seek ownership Stay hungry Remain grounded Create impact Challenge with respect We’ve built our culture around creativity, continuous learning, and our shared values. If that sounds like something you’d like to be a part of, then join us today! Software Engineer Aviture is hiring a Software Engineer. Aviturians understand how technology can change the world and have the technical skills to make those visions a reality. Aviturians are always eager to learn, share, collaborate, grow, and innovate. (We also share a good meme or thirty.) We’re looking for a rockstar Software Engineer who will… Work with a cross-functional team to design, develop, test and deploy innovative solutions to a wide range of complex business problems. Actively participate in all aspects of our agile development process. Utilize effective debugging techniques to identify and resolve software defects. Continuously keep themselves up to date on changes in technology, with an emphasis on the tech stacks being used by your team. Sound like you? Apply today: Requirements BS degree in Software Engineering related degree, similar technical field of study or equivalent practical experience. Excellent verbal and written communication skills. Able to respectfully challenge the status quo. Experience developing and maintaining large-scale applications using one or more general purpose programming languages, such as:Python, Java, C#/.NET, Go, JavaScript, TypeScript Experience with one or more modern frontend technologies is a plus: ReactJS, AngularJS, VueJS, etc. Able to work both autonomously, as well as collaboratively among a team of your peers. Excellent grasp of computer science concepts, proven ability to solve complex technical problems. Experience using common design patterns in the software industry. High personal standards for code quality, maintainability, and performance. This position will require the employee to have a Secret level Government clearance or the ability to obtain one. This position will require the employee to work in person at an off-site location. Benefits PPO or a High Deductible Health Plan, HSA eligible plan, Dental, Vision, and Supplemental Life. Generous paid time off that starts accruing on day one. Hybrid work environment with quarterly Castaway Week events in the Omaha HQ Office, all expenses paid, from across the country to participate in team-building, collaboration, and fun events. Company vacations!!! Previous destinations have included Napa Valley, Cancun, Cabo San Lucas and Aspen. Matching 401k with 100% vesting in six months. Pick your preferred workstation! Mac? PC? We’ll support you with the tech you need to do your best work. Get paid to go to national and international conferences and training, so that you can stay up to date with the latest innovations. Flexible work schedules: Work the times that fits your schedule, with all meetings required to be scheduled between 9 am and 3 pm CST. Free lunch every Friday and recurring team events for you and your family to enjoy. Incentive and bonus pay. Opportunities for connection and growth through peer coaching, recurring Lightning Talks to share things we’re passionate about, and a bi-weekly company-wide All Hands.
Omaha, NE, USA
Negotiable Salary
Workable
Freelance Software Developer (Ruby) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects.  Although every project is unique, you might typically: Generate prompts that challenge AI. Define comprehensive scoring criteria to evaluate the accuracy of the AI’s answers. Correct the model’s responses based on your domain-specific knowledge. How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have at least 3 years of professional experience with Ruby. Code review experience is a must. Experience with AI projects is a plus. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
New York, NY, USA
$50
Workable
Cloud Software Engineer, FinOps
ABOUT US: Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.  Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.  KEY RESPONSIBILITIES: Develop and implement microservices and processes using Java and Spring Boot framework for monitoring, analyzing, and forecasting cloud spending across AWS, OCI, Azure etc. Collaborate with product teams and development teams across the organization to understand cloud usage patterns and identify optimization opportunities; both technical and functional. Provide regular reports and insights on cloud spending trends, optimization efforts, and cost-saving achievements. Work closely with development teams to optimize application performance and reduce cloud costs without impacting service quality. Participate in the design and deployment of highly available and cost-optimized cloud infrastructure solutions on platforms like AWS, Azure, GCP, or OCI. Lead initiatives to educate teams on best practices for cloud cost management and efficiency. Drive a culture of cost-awareness and financial accountability within the tech department. Requirements REQUIRED QUALIFICATIONS Bachelor's degree or higher in Computer Science, Information Technology, or a related field. Minimum 1 years of experience as a developer with cloud engineering. Proven experience as a Java Developer and in-depth knowledge of Spring Boot framework. Experience with database design concepts and data modeling for RDBMS (MySQL) or NoSQL (MongoDB, Cassandra). Excellent communication and collaboration skills, with the ability to work effectively in a fast-paced environment. PREFERRED QUALIFICATIONS Hands-on experience with containerization technologies including Docker and Kubernetes. Proficiency in cloud platforms (e.g., AWS, Azure, GCP, OCI) with a strong focus on FinOps best practices and experience implementing cost-saving solutions. English-speaking environment, bilingual proficiency in Mandarin preferred. Benefits Salary Range: $100,000 - 140,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$100,000-140,000/year
Craigslist
Meat/Fish Supermarket Supervisor (Queens)
Meat & Fish Supervisor for a successful supermarkets located in Queens for over 40 year Job Summary: We are seeking a dedicated and experience Meat/Fish Supervisor to oversee our meat departments at our chain of supermarkets in Queens. The Meat/Fish Supervisor will be responsible for ensuring the smooth operation of the meat/fish, managing a team of meat cutters and ensuring the highest level of customer service. Key Responsibilities • Supervise daily meat/fish department operations ensuring quality, safety and cleanliness standards • Train, schedule and manage a team of meat cutters • Making weekly meat ads for our circular and pricing for all meat & fish • Managing a team of meat cutters • Ensure that all meat products are properly prepared, packaged and display properly • Monitor inventory levels • Ensure all equipment is in good working order and that all food safety and sanitation guidelines are met • Must be able to perform Meat/Fish Manage responsibilities in absence of Meat Manager Qualifications’ • Must speak Spanish • Minimum of 5 years’ experience in meat department and supervisory experience preferred • Proficient in meat cutting test • Strong organizational skills and attention to detail • Must be able to work flexible hours including evenings and weekends • Proficient with Microsoft office Salary and Benefits • Full Benefits including Medical • Benefits and compensation depend upon experience*
35-34 84th St, Jackson Heights, NY 11372, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.