Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
.Net Developer
Role: .Net Developer Location: Redmond, WA(Onsite) Position Type: Contract Job Description:- Must Have Skills: • 3+ years of hands-on development experience with Kubernetes/Azure Kubernetes Service (AKS) Experience with Azure DevOps or GitHub Actions for CI/CD pipelines • 6+ years of experience in software development using C# and .NET Core /.NET Framework • Working on DevSecOps practices and secure coding standards for AKS deployments • Cloud above ARM deployment experience and CIS/RPv2 Deployments • ARM Templates: Expertise in authoring and modifying Azure Resource Manager (ARM) templates Good to Have Skills: •  Experience with other Azure services such as Azure SQL, Azure Data Factory, and Blob Storage •  Knowledge of RESTful APIs and microservices architecture •  Python, PowerShell, YAML/JSON •   Certifications such as Microsoft Certified: Azure Developer Associate or Kubernetes Administrator Responsibilities: •  Design, develop, and maintain C# applications for cloud-native environments. •  Automate deployment workflows for AKS and Above ARM services •  Integrate CIS buildout automation into existing pipelines and workflows •  Collaborate with cloud engineers, DevOps, and security teams to ensure secure and scalable deployments •  Troubleshoot and resolve deployment issues across environments •  Maintain documentation and contribute to continuous improvement of buildout processes
Redmond, WA, USA
Negotiable Salary
Workable
EDM Master Applications Developer
**This position is contingent on contract award** RMC is seeking a highly skilled Master Applications Developer to serve as the EDM Technical Lead for the United States Marine Corps Cyberspace Operations Group (MCCOG) in Quantico, VA. This role is critical in supporting the technical, engineering, operations, maintenance, and management functions that ensure the security and effectiveness of the Marine Corps Enterprise Network (MCEN). The MCEN supports over 200,000 users globally, operating behind NIPRNET and SIPRNET boundaries, and includes a complex suite of enterprise virtual server infrastructure, storage area networks, and messaging environments.   Key Responsibilities   Lead and mentor senior technical teams operating in a geographically distributed, classified network environment supporting over 200,000 users. Oversee the engineering, deployment, and maintenance of enterprise-level Active Directory, Microsoft Exchange, SAN, and Virtualization environments. Provide technical leadership for the design, integration, and management of firewalls, routers, switches, VPN devices, and enterprise virtual server infrastructure. Engineer and manage enterprise NetApp storage and VMware virtualization solutions. Utilize Microsoft System Center to automate and optimize critical operational tasks. Ensure compliance with cybersecurity best practices and maintain a tightly integrated, agile, defensible, and survivable network supporting both distributed operations and business enterprise needs. Collaborate with stakeholders to analyze user needs, troubleshoot technical issues, and implement innovative solutions. Guide and supervise system modifications, conduct security audits, and ensure the continuous improvement of network operations. Maintain documentation and provide regular assessments, maintenance, and enhancements of existing applications and infrastructure. Serve as the subject matter expert for enterprise network operations and contribute to strategic planning and risk management. Requirements Minimum seven (7) years of experience leading senior technicians in a geographically distributed, classified network environment. At least five (5) years of experience supporting enterprise-level Active Directory, Microsoft Exchange, SAN, and Virtualization environments. Information Assurance Technical (IAT) Level III certification. AZ-800/801 or M365 Enterprise Admin certification TS/SCI security clearance. ITIL v4 Foundation Certification. Demonstrated experience supporting enterprise network environments with at least 200,000 users. Proven expertise in engineering and managing enterprise NetApp storage and VMware solutions. Desired Skills   Strong technical leadership and mentoring abilities. Excellent problem-solving skills and the ability to innovate under pressure. Exceptional communication and interpersonal skills for effective collaboration with both technical and non-technical stakeholders. Commitment to continuous learning and staying current with industry trends and emerging technologies. Ability to manage multiple priorities in a fast-paced, mission-critical environment.   Benefits At RMC, we're committed to your career growth! RMC differentiates itself from other firms through its investment in our employees. We invest our resources to train, certify, educate, and build our employees. RMC can offer you a great place to work with a small company feel and give you the experience and certifications that will take your career to the next level. RMC also offers high-quality, low-deductible healthcare plans and a competitive 401K package. * Salary at RMC is determined by various factors, including but not limited to location, a candidate's specific combination of education, knowledge, skills, competencies, and experience, as well as contract-specific requirements. The current salary range for this position will be $140,000.00 to $174,000.00 annually.
Quantico, VA 22134, USA
$140,000-174,000
Workable
.NET API Specialist
Role: .NET API Specialist Location: Dallas, TX(4 days onsite)- . Yrs of exp:10+   Your responsibilities in this role will include: Lead the design, development, and implementation of robust and scalable .NET Core APIs. Hands-on Knowledge on SQL queries Collaborate with cross-functional teams to gather requirements and architect solutions. Hands-on coding and debugging of API components to ensure high performance and reliability. Mentor junior developers and provide technical guidance and support. Stay current with industry trends and best practices, particularly in cloud technologies. Extensive experience in developing .NET APIs using C#. Strong proficiency in cloud platforms such as AWS, Azure, or Google Cloud Platform. Demonstrated expertise in designing and implementing RESTful APIs. Solid understanding of software development methodologies and practices. Excellent communication skills and ability to collaborate effectively with teams. Knowledge of microservices architecture. Familiarity with DevOps practices and tools.   Requirements: Bachelor’s degree in computer science, Engineering, or a related field. Proven experience as a .NET/C# Developer with a minimum of 8 years in software development. Strong proficiency in C#, ASP.NET, and the .NET Framework. Solid understanding of software development principles and best practices. Good in database systems (Oracle RDBMS, etc.). Excellent problem-solving and communication skills. Ability to work independently and collaboratively within a team. Primary skills:  SQL NET API AZURE AWS KUBERNETES ORACLE RDBMS KAFKA DOCKER KUBERNETES CI/CD PIPELINE C#
Dallas, TX, USA
Negotiable Salary
Workable
Elite Applications Engineer
Seeking a full-time Enterprise Applications Engineer for an on-site role. This person will be responsible for administration, monitoring and maintenance of the Accounting enterprise applications. Responsibilities: Administer and support the Firm's Elite 3E platform Serves as the subject matter expert and technical resource for the Firm’s financial system both within the financial group and the IT department by providing expertise on issues of functionality, integration, performance/troubleshooting, design, deployment etc. Administer all other systems in the Firm’s financial platform including various supporting systems in the 3E Elite application and tools including (but not limited to) Paperless Performa, IDE, Design Gallery (EDG), Workspace. Responsible for the administration and support tasks related to the Elite 3E system. This can include but is not limited to: Scheduled month-end maintenance Upgrades to 3E, Workspace, and other related software systems Coordinate with database and application administrators on projects which are related to the financial system Responsible for development deliverables of Elite 3E customizations (forms, inquiries, reports, metrics, etc.) with quality and consistent integration between key financial applications and Document customization solutions. Analyze and work with the Financial team users and IT team on the impact of vendor software upgrades Coordinates with both the Accounting and IT team, to prioritize and address issues and objectives for financial systems Responsible for testing financial system applications during system changes, enhancements, upgrades and monthly system maintenance, as well as, documentation of system integrations, backup and disaster recovery processes Project Management - create, track and update all Elite 3E customization and new project tasks. Work closely with the Accounting team to deliver strategic projects Informs the department and management in a timely manner of project status, issues and proposed resolutions. Manage vendor support tickets Track and optimize system performance and storage utilization, plan for necessary hardware or software upgrades to support system growth Research and evaluate new technologies to improve current application processes. Utilize tools to protect application source code, and maintain versioning. Requirements 3+ years’ experience operating with legal accounting and time management software required, experience with Elite 3E preferred Experience with maintaining Proforma Tracker, 3E Templates, 3E Workspace and BizTalk. Proficiency in Elite Application Framework and Tools, including the IDE, Design Gallery (EDG) Experience administering Windows Server Intermediate to advanced knowledge of SQL Application installation and configuration experience Fluency in the Elite 3E SQL database schema preferred or demonstrated ability to develop such fluency 5+ years’ experience in the management, design and implementation of Windows computer systems. Experience administering and maintaining Microsoft SQL and MS Active Directory is desirable. Experience with iManage document management administration, Thomson Reuters 3e Accounting management systems and Foundations system administration preferred. Microsoft Certified Systems Engineer (MCSE) preferred, but not required.
Hackensack, NJ, USA
Negotiable Salary
Workable
TIBCO Developer
Role: TIBCO Developer Location: Jackson MI -  Hybrid mode Position Type: Contract   We are seeking a TIBCO Developer to join the integration team supporting Consumers Energy in Jackson, MI. The ideal candidate will have strong expertise in TIBCO Business  Works 6.x and a solid understanding of enterprise integration patterns.   Responsibilities:   ·       Design, develop, and support integration solutions using TIBCO BusinessWorks 6.x and 5.x, TIBCO EMS, API development and TIBCO BusinessEvents. ·       Develop and maintain APIs using TIBCO API Exchange, including RESTful and SOAP web services ·       Configure and monitor messaging using TIBCO EMS, Hawk, and Rendezvous ·       Collaborate with business analysts, architects, and other developers to deliver high-quality integration solutions ·       Troubleshoot and resolve production issues in a timely manner ·       Participate in code reviews and deployment processes ·       Ensure integration components adhere to security, performance, and scalability standards   Required Qualifications:   ·       5+ years of hands-on experience with: ·       TIBCO BusinessWorks (BW) 6.x and 5.x ·       TIBCO EMS, Hawk, BusinessEvents ·       TIBCO Rendezvous and API Exchange Gateway ·       Solid understanding of SOA and integration architecture ·       Experience with RESTful and SOAP APIs ·       Familiarity with DevOps, CI/CD pipelines, and Git-based versioning ·       Strong debugging and troubleshooting skills in enterprise environments ·       Ability to work independently in a hybrid/remote setup ·       Strong verbal and written communication skills   Nice to Have:   ·       Knowledge of Containers (Docker/Kubernetes) and Cloud platforms (Azure or AWS) ·       Experience with other integration technologies or scripting languages ·       Prior experience working in utility or energy sectors   Note: they need BW and BE development skills, not just one or the other, can good comminication skills, clear english, I am also asking if they are willing to relocate to Jackson Mi, along with API development  
Jackson, MS, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.