Amazon Web Services (AWS)Job Title: Data Engineer
Cargill’s size and scale allows us to make a positive impact in the world. Our purpose is to nourish the world in a safe, responsible and sustainable way. We are a family company providing food, ingredients, agricultural solutions and industrial products that are vital for living. We connect farmers with markets so they can prosper. We connect customers with ingredients so they can make meals people love. And we connect families with daily essentials — from eggs to edible oils, salt to skincare, feed to alternative fuel. Our 160,000 colleagues, operating in 70 countries, make essential products that touch billions of lives each day. Join us and reach your higher purpose at Cargill.
Job Purpose and Impact
As a Data Engineer at Cargill you work across the full stack to design, develop and operate high performance and data centric solutions using our comprehensive and modern data capabilities and platforms. You will play a critical role in enabling analytical insights and process efficiencies for Cargill’s diverse and complex business environments. You will work in a small team that shares your passion for building innovative, resilient, and high-quality solutions while sharing, learning and growing together.
Key Accountabilities
Collaborate with business stakeholders, product owners and across your team on product or solution designs.
· Develop robust, scalable and sustainable data products or solutions utilizing cloud-based technologies.
· Provide moderately complex technical support through all phases of product or solution life cycle.
· Perform data analysis, handle data modeling, and configure and develop data pipelines to move and optimize data assets.
· Build moderately complex prototypes to test new concepts and provide ideas on reusable frameworks, components and data products or solutions and help promote adoption of new technologies.
· Independently solve moderately complex issues with minimal supervision, while escalating more complex issues to appropriate staff.
· Other duties as assigned
Qualifications
MINIMUM QUALIFICATIONS
· Bachelor’s degree in a related field or equivalent experience
· Minimum of two years of related work experience
· Other minimum qualifications may apply
PREFERRED QUALIFCATIONS
· Experience developing modern data architectures, including data warehouses, data lakes, data meshes, hubs and associated capabilities including ingestion, governance, modeling, observability and more.
· Experience with data collection and ingestion capabilities, including AWS Glue, Kafka Connect and others.
· Experience with data storage and management of large, heterogenous datasets, including formats, structures, and cataloging with such tools as Iceberg, Parquet, Avro, ORC, S3, HFDS, HIVE, Kudu or others.
· Experience with transformation and modeling tools, including SQL based transformation frameworks, orchestration and quality frameworks including dbt, Apache Nifi, Talend, AWS Glue, Airflow, Dagster, Great Expectations, Oozie and others
· Experience working in Big Data environments including tools such as Hadoop and Spark
· Experience working in Cloud Platforms including AWS, GCP or Azure
· Experience of streaming and stream integration or middleware platforms, tools, and architectures such as Kafka, Flink, JMS, or Kinesis.
· Strong programming knowledge of SQL, Python, R, Java, Scala or equivalent
· Proficiency in engineering tooling including docker, git, and container orchestration services
· Strong experience of working in devops models with demonstratable understanding of associated best practices for code management, continuous integration, and deployment strategies.
· Experience and knowledge of data governance considerations including quality, privacy, security associated implications for data product development and consumption.
Equal Opportunity Employer, including Disability/Vet.
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs
Vue.js
AngularJS (1.x)
Angular (2+)
React.js
JavascriptWordPress: As a WordPress Developer, you will be responsible for designing and developing engaging and responsive websites using WordPress. You will collaborate with cross-functional teams to deliver high-quality web solutions that align with our goal.
Responsibilities:
- Develop and maintain custom WordPress themes and plugins, ensuring responsive design and optimal performance.
- Collaborate with UI/UX designers to convert designs into functional websites while maintaining visual and brand consistency.
- Customize and extend existing WordPress functionalities to meet specific project requirements.
- Optimize website performance, including page load times, user experience, and mobile responsiveness.
- Debug and troubleshoot website issues and implement timely solutions.
Qualifications:
- Bachelor's degree in Computer Science, Web Development, or a related field (preferred but not required).
- Proven experience as a WordPress Developer with a strong portfolio showcasing previous projects.
- Proficiency in HTML, CSS, JavaScript, PHP, and MySQL.
- Experience with responsive design principles and frameworks.
- Solid understanding of web performance optimization techniques.
- Strong problem-solving skills and attention to detail.
- Excellent communication skills and ability to work collaboratively in a team environment.
- Self-motivated with the ability to manage multiple projects and meet deadlines.
Data AnalyticsSomeone who has prior experience in Product Analytics/Marketing Analytics/Growth Analytics/Consumer analytics domain.
Has the ability to define success metrics for different initiatives or campaigns, drive ROI analysis & provide recommendations.
Strong analytics acumen and problem solving skills.
Good understanding of Clickstream/App events data, ability to build and understand user journeys across platforms.
Understanding of LTV modelling
Strong SQL skills and comfortable with python programming.
Basic knowledge of different regression models & clustering techniques.
• Highly motivated SAP FICO functional consultant : Accounts Receivable, Accounts Payable, General Ledger, Treasury, Fixed Assets, Biller Direct
• Proficient on SAP FICO functional areas, knowing details of core customizing, related database tables, processing transactions
• Able to design, execute complex business process on its current area, naming the transactions, analyze business process errors
• Ability to design and document complex Functional specifications for Reports, Interfaces, Conversions, Enhancements, and workflows
• Experience Raising SAP OSS tickets
Our client focuses on providing solutions in terms of data, analytics, decisioning and automation. They focus on providing solutions to the lending lifecycle of financial institutions and their products are designed to focus on systemic fraud prevention, risk management, compliance etc.
Our client is a one stop solution provider, catering to the authentication, verification and diligence needs of various industries including but not limited to, banking, insurance, payments etc.
Headquartered in Mumbai, our client was founded in 2015 by a team of three veteran entrepreneurs, two of whom are chartered accountants and one is a graduate from IIT, Kharagpur. They have been funded by tier 1 investors and have raised $1.1M in funding.
What you will do:
- Developing and executing recruiting plans to meet the hiring requirements
- Building and maintaining an active pool of candidates to meet future hiring targets in an effective manner
- Designing and driving employee referral programs
- Developing and implementing a strong campus hiring program, with the aim to make us the employer of choice
- Planning and coordinating events, assessment, and interviews for hiring candidates
- Serving as liaison with candidates and communicating logistics associated with assessment and interviews
- Conducting background checks for shortlisted candidates
- Implementing the on-boarding program for all selected candidates
- Conducting regular follow-up meetings with hiring managers to determine the effectiveness of recruiting plans and implementation
- Providing advice and assistance to all levels on various recruiting/ talent acquisition related matters
- Utilizing metrics to identify and implement process improvements
- Conducting analysis and report on key recruitment metrics to appropriate business leaders
Desired Candidate Profile
What you need to have:- 5+ years of experience in Talent Acquisition, 2+ years in a team management role
- Ability to lead & manage recruitment function apart from sourcing individually
- Willingness to learn and take up new challenges
- Ability to work independently, spontaneously with very less monitoring
- Excellent verbal and written communication skills
- A can-do attitude
Ruby on Rails (ROR)
RubyRuby on Rails Developer Responsibilities:
• Designing and developing new web applications.
• Maintaining and troubleshooting existing web applications.
• Writing and maintaining reliable Ruby code.
• Integrating data storage solutions.
• Creating back-end components.
• Identifying and fixing bottlenecks and bugs.
• Integrating user-facing elements designed by the front-end team.
• Connecting applications with additional web servers.
• Maintaining APIs.
Ruby on Rails Developer Requirements:
• Bachelor’s degree in Computer Science, Computer Engineering, or related field.
• Experience working with Ruby on Rails as well as libraries like Resque and RSpec.
• Ability to write clean Ruby code.
• Proficiency with code versioning tools including Git, Github, SVN, and Mercurial.
• Experience with AngularJS or BackboneJS.
• Familiarity with MVC, Mocking, RESTful, and ORM.
• Good understanding of front-end technologies including HTML5, JavaScript, and CSS3.
• Knowledge of server-side templating languages including Slim and Liquid.
- Databases- MongoDb, Postgres.
- Technical skills:
- Primary skills :
- Siebel CSW
Should have hands on experience Siebel Configuration, Scripting and Workflows
- Siebel Integration
Should have hands on experience Siebel integrations like JMS\MQ, Web services, VBC, EBC, Rest Service, API building etc.
- Siebel OpenUI
Should have hands on experience in Siebel OpenUI development.
- Database (SQL /Oracle)
Should have good experience in writing queries, performance management, query optimization etc.
- Should be able to work independently and should have strong debugging skills
- Secondary skills : (Good to have)
- Siebel certification
- Exposure to Agile
- Exposure to HP ALM and JIRA
- Candidate’s overall experience should be min 5 years to max 8 years.
● Setting a vision for how technology will be used in the company.
● Ensuring that technological resources meet the company's short and long-term needs.
● Work closely with Product, Marketing, Business Development and Operations to define
and deliver new products and enhancements
● Outline the goals for research and development.
● Creating timelines for the development and deployment of all technologicalservices.
● Maintaining a consumer-focused outlook and aiding in the delivery of Technology
projects to market.
● Managing technology budgets and time frames.
● Staying on top of technology trends and developments.
● Ensuring all technology practices adhere to regulatory standards.
● Making executive decisions on behalf of the company's technologicalrequirements.
● Keep track of Technology budgets in order to update the performance of technology
Job Requirements:
● Proven experience as a Head of Technology, CTO or similar leadership role
● Knowledge of technological trends to build strategy
● Understanding of budgets and business-planning
● Ability to conduct technological analyses and research
● 12 years working in a technological role with 8 years managerial experience.
● Exceptional team management skills.
● Excellent verbal and written communication.
● Extensive industry knowledge with an eye towards the future
Docker
Kubernetes
JenkinsAmazon Web Services (AWS)Responsibilities
- Designing and building infrastructure to support AWS, Azure, and GCP-based Cloud services and infrastructure.
- Creating and utilizing tools to monitor our applications and services in the cloud including system health indicators, trend identification, and anomaly detection.
- Working with development teams to help engineer scalable, reliable, and resilient software running in the cloud.
- Participating in on-call escalation to troubleshoot customer-facing issues
- Analyzing and monitoring performance bottlenecks and key metrics to optimize software and system performance.
- Providing analytics and forecasts for cloud capacity, troubleshooting analysis, and uptime.
Skills
- Should have strong experience of a couple of years, in leading DevOps team and planning, defining DevOps roadmap and executing as per the same along with the team
- Familiarity with AWS cloud and JSON templates, Python, AWS Cloud formation templates
- Designing solutions using one or more AWS features, tools, and technologies such as EC2, EBS, Glacier, S3, ELB, CloudFormation, Lambada, CloudWatch, VPC, RDS, Direct Connect, AWS CLI, REST API
- Design and implement system architecture with AWS cloud - Develop automation scripts, ARM templates, Ansible, Chef, Python, Powershell Knowledge of AWS services and cloud design patterns- Knowledge on Cloud fundamentals like autoscaling, serverless
- Have experience with DevOps and Infrastructure as Code: AWS environment and application automation utilizing CloudFormation and third-party tools. CI/CD pipeline setup utilizing
- CI experience with the following is a must: Jenkins, Bitbucket/GIT, Nexus or Artifactory, SonarQube, WireMock or other mocking solution
- Expert knowledge on Windows/Linux OS/Mac with at least 5-6 years of system administration experience
- Should have strong skills in using JIRA build tool
- Should have knowledge in managing the CI/CD pipeline on public cloud deployments using AWS
- Should have strong skills in using tools like Jenkins, Docker, Kubernetes (AWS EKS, Azure AKS), and Cloudformation.
- Experience in monitoring tools like Pingdom, Nagios, etc.
- Experience in reverse proxy services like Nginx and Apache
- Desirable experience in Bitbucket with version control tools like GIT/SVN
- Experience of manual/automated testing desired application deployments
- Experience in database technologies such as PostgreSQL, MySQL
- Knowledge of helm and terraform
.NET
C#
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon