Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Senior Mobile App Development Engineer
Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.    Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.    Overview: Are you a seasoned mobile app developer with a strong track record of building and leading high-performance applications? Do you thrive in an environment that values scalability, security, and seamless user experiences? If so, this Senior Mobile App Development Engineer role could be the perfect fit for you!   As a Senior Engineer, you will play a key role in designing, developing, and maintaining enterprise-level mobile applications that power TP-Link's excellent networking solutions. You will drive technical decisions, mentor junior developers, and collaborate with cross-functional teams to deliver cutting-edge mobile experiences.   If you’re passionate about building high-caliber mobile applications, we’d love to have you on board! Spearhead the end-to-end development lifecycle of high-caliber mobile applications for both iOS and Android platforms. Design, develop, release, and maintain complex mobile applications, driving them from conception to successful launch. Collaborate seamlessly with cross-functional teams, including designers, product managers, and QA engineers, to deliver unparalleled user experiences. Provide technical leadership, mentorship, and guidance to junior team members, fostering a collaborative and high-performing environment. Conduct meticulous code reviews and provide mentorship to junior developers, ensuring strict adherence to coding standards and industry best practices. Stay at the forefront of the mobile development landscape by actively researching, learning, and advocating for the adoption of innovative technologies, platforms, and architectures. Analyze and optimize application performance, guaranteeing responsiveness and a seamless user experience. Contribute to the overall architecture and strategic vision of our mobile app development initiatives. Requirements Bachelor's degree in Computer Science, Software Engineering, or a related field.    Proven track record as a Mobile App Developer, showcasing a robust portfolio of successfully released applications. Minimum of 5 years of hands-on experience in mobile app development. Proficiency in programming languages such as Swift (for iOS) and Kotlin/Java (for Android). Extensive knowledge of mobile app architectures, UI/UX principles, and industry best practices. Constantly prioritizing user experience and clear understanding of user requirements. Expertise with version control systems (e.g., Git), continuous integration, and deployment pipelines. Exceptional problem-solving skills and a demonstrated ability to troubleshoot complex issues. Outstanding leadership, communication and collaboration skills. Able to actively listen and establish best practices for remote global development teams. Preferred Qualifications: Familiarity with cross-platform development frameworks such as React Native or Flutter. Backend development experience and integration proficiency. Actual implementation using SwiftUI or Jetpack Compose. Extensive experience in audio and video processing. Experience in MRE processing. Benefits Salary range: $140,000 - $200,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time. Apply for this job
Irvine, CA, USA
$140,000-200,000/year
Workable
Principal Software Engineer - Python
Job Title Principal Software Engineer - Python AI Pipelines Overview We are looking for an experienced software engineer to help us build a new generation of transpilation tools enabled by AI and modern verification techniques that promises to bridge the gap between algorithm development and deployment to embedded systems. In this role you will play a lead role in architecting and implementing novel code generation pipelines that use a mix of Generative AI, Static Analysis and Formal Verification methods to translate code written in one language to another. Requirements Responsibilities ● Define Software Architecture for Agentic AI pipelines. Architect and implement complex workflows involving state machines, message queues, and distributed processing. ● Deploy and manage containerized services using Docker. ● Build well tested extensible code foundations for code translation products. ● Collaborate with domain specialists to incorporate formal verification and static analysis methods into code generation pipeline. ● Work with cloud services and distributed architectures to ensure high availability. Must Have ● Seven or more years of experience with collaborative enterprise-level software development in Python to deliver products to a large customer base ● Demonstrated experience gathering requirements from stakeholders and distilling them into software designs ● Demonstrated experience planning and executing on large projects in a team-based setting ● Demonstrated history of building and delivering robust software by employing best practices throughout the SDLC process, including Code review, Testing, Continuous integration, Release management and Build systems ● Experience with Machine Learning Tools and Frameworks ● Expertise in building scalable APIs (REST, GraphQL, gRPC). ● Hands-on experience with Docker and containerized application development. Great to Have ● Strong experience with workflow orchestration, state machines, and message queues (e.g., RabbitMQ, Kafka, Redis, Celery). ● Familiarity with PromptFlow or similar workflow automation tools. ● Experience working with cloud-based distributed systems (AWS, GCP, Azure).
Boston, MA, USA
Negotiable Salary
Workable
AWS Cloud Developer
Candidates must have experience developing software applications in an  AWS Cloud environment. This is NOT a DevOps or Cloud Engineer position. Possibility for extensions. Project Overview: The GTA CJEP project is a modernization of the Criminal Justice Exchange Program that shares data between different agencies, counties, cities, etc.  This project will take the current SoftwareAG centric solution and produce a Cloud Native solution in AWS to move and consolidate data for counties that sign-up for the service.  The touchpoints for this data sharing will be third party vendors as well as state and county systems.  Current API’s and web services will be leveraged to facilitate this modernized solution as much as possible. Position Overview: As an AWS Cloud Developer at GTA you will play a crucial role in designing, developing, and maintaining scalable cloud solutions on the AWS platform. You will collaborate closely with cross-functional teams in a SCRUM Agile environment to deliver high-quality software solutions that meet business objectives. The ideal candidate will have extensive experience with SOAP-based web services,custom header implementation, and handling MTOM (Message Transmission Optimization Mechanism) attachments Key Responsibilities: Design, develop, and deploy cloud-native applications on AWS using services such as Lambda, API Gateway, DynamoDB, S3, and others as needed. Implement serverless architectures using AWS Lambda functions with Python. Build and orchestrate workflows using AWS Step Functions and AWS State Machines. Design, develop, and implement SOAP-based web services using services technologies. Create and manage custom headers for web services to ensure security, authentication, and data integrity. Implement MTOM attachments such as PDF for efficient transmission of binary data in web services. Collaborate with Product Owners, Scrum Masters, and other team members to refine user stories and deliver solutions iteratively. Ensure code quality, performance, and scalability through automated testing, code reviews, and adherence to best practices. Troubleshoot and resolve issues in development, testing, and production environments. Stay current with AWS services, tools, and best practices and share your knowledge within the team. Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent practical experience). Proven experience with XML, XSD, WSDL, and other related technologies Proven experience as a software developer with a strong understanding of cloud computing principles and practices. Hands-on experience designing and developing applications on AWS cloud services, particularly Lambda, API Gateway, DynamoDB, and S3. Proficiency in Python programming language; familiarity with other languages is a plus. Experience with AWS Step Functions and State Machines is highly desirable. Familiarity with Agile methodologies and SCRUM framework. Strong problem-solving skills and ability to work effectively in a team environment. Excellent verbal and written communication skills. Preferred Qualifications: AWS certifications (e.g., AWS Certified Developer) are a plus. Experience with CI/CD pipelines and DevOps practices. Familiarity with containerization (e.g., Docker) and orchestration (e.g., Kubernetes).
Atlanta, GA, USA
Negotiable Salary
Workable
SAP FICO - Freshers Needed for Project Implementation process- Remote
SAPSOL Technologies Inc. is looking for recent degree holders who are passionate about SAP and eager to start their careers as SAP FICO Consultants. If you are a recent graduate or someone with little to no prior work experience and you have a passion for SAP and are eager to work in cutting-edge technology areas, this could be an excellent opportunity to kick start your career. Key Responsibilities: Analyze business requirements and translate them into SAP FICO solutions. Configure and customize the SAP FICO modules to align with business processes. Provide functional expertise in SAP FI (Financial Accounting) and CO (Controlling) modules. Conduct system testing, integration testing, and user acceptance testing. Provide end-user training and support. Collaborate with cross-functional teams to ensure seamless integration with other SAP modules. Troubleshoot and resolve issues related to SAP FICO modules. Document functional specifications, processes, and system configurations. Qualifications and Requirements: Bachelor's degree in Finance, Accounting, Information Technology, or a related field. Extensive experience in SAP FICO module configuration and implementation. Strong understanding of integration with other SAP modules and related technologies. Strong knowledge of SAP FICO modules, including General Ledger (GL), Accounts Payable (AP), Accounts Receivable (AR), Asset Accounting (AA), Cost Center Accounting (CCA), and Profit Center Accounting (PCA). Problem-solving skills and ability to communicate effectively with both technical and non-technical stakeholders. Project management skills and experience working on SAP implementation projects. SAP FICO certification is a significant advantage. Ability to adapt to changing business needs and technologies. Visa Type- EAD/GC/USC Only Email your resumes as soon as possible to neelam@sapsol.com
Remote, OR 97458, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.