Job Title: Data Engineer
Cargill’s size and scale allows us to make a positive impact in the world. Our purpose is to nourish the world in a safe, responsible and sustainable way. We are a family company providing food, ingredients, agricultural solutions and industrial products that are vital for living. We connect farmers with markets so they can prosper. We connect customers with ingredients so they can make meals people love. And we connect families with daily essentials — from eggs to edible oils, salt to skincare, feed to alternative fuel. Our 160,000 colleagues, operating in 70 countries, make essential products that touch billions of lives each day. Join us and reach your higher purpose at Cargill.
Job Purpose and Impact
As a Data Engineer at Cargill you work across the full stack to design, develop and operate high performance and data centric solutions using our comprehensive and modern data capabilities and platforms. You will play a critical role in enabling analytical insights and process efficiencies for Cargill’s diverse and complex business environments. You will work in a small team that shares your passion for building innovative, resilient, and high-quality solutions while sharing, learning and growing together.
Key Accountabilities
Collaborate with business stakeholders, product owners and across your team on product or solution designs.
· Develop robust, scalable and sustainable data products or solutions utilizing cloud-based technologies.
· Provide moderately complex technical support through all phases of product or solution life cycle.
· Perform data analysis, handle data modeling, and configure and develop data pipelines to move and optimize data assets.
· Build moderately complex prototypes to test new concepts and provide ideas on reusable frameworks, components and data products or solutions and help promote adoption of new technologies.
· Independently solve moderately complex issues with minimal supervision, while escalating more complex issues to appropriate staff.
· Other duties as assigned
Qualifications
MINIMUM QUALIFICATIONS
· Bachelor’s degree in a related field or equivalent experience
· Minimum of two years of related work experience
· Other minimum qualifications may apply
PREFERRED QUALIFCATIONS
· Experience developing modern data architectures, including data warehouses, data lakes, data meshes, hubs and associated capabilities including ingestion, governance, modeling, observability and more.
· Experience with data collection and ingestion capabilities, including AWS Glue, Kafka Connect and others.
· Experience with data storage and management of large, heterogenous datasets, including formats, structures, and cataloging with such tools as Iceberg, Parquet, Avro, ORC, S3, HFDS, HIVE, Kudu or others.
· Experience with transformation and modeling tools, including SQL based transformation frameworks, orchestration and quality frameworks including dbt, Apache Nifi, Talend, AWS Glue, Airflow, Dagster, Great Expectations, Oozie and others
· Experience working in Big Data environments including tools such as Hadoop and Spark
· Experience working in Cloud Platforms including AWS, GCP or Azure
· Experience of streaming and stream integration or middleware platforms, tools, and architectures such as Kafka, Flink, JMS, or Kinesis.
· Strong programming knowledge of SQL, Python, R, Java, Scala or equivalent
· Proficiency in engineering tooling including docker, git, and container orchestration services
· Strong experience of working in devops models with demonstratable understanding of associated best practices for code management, continuous integration, and deployment strategies.
· Experience and knowledge of data governance considerations including quality, privacy, security associated implications for data product development and consumption.
Equal Opportunity Employer, including Disability/Vet.
Similar jobs
Job Description:
We are looking for a highly skilled Software Developer with 3-5 years of hands-on experience in LAMP Stack development. The ideal candidate will be responsible for developing and maintaining web applications, ensuring high performance, and collaborating with cross-functional teams to define and ship new features.
Key Responsibilities:
• Develop, maintain, and optimize web applications using LAMP Stack (Linux, Apache, MySQL, PHP)
• Design efficient, scalable, and secure backend systems.
• Collaborate with frontend developers and project stakeholders to deliver high-quality products.
• Write well-structured and testable code, following best practices in PHP.
• Troubleshoot, debug, and upgrade existing applications.
• Develop APIs and integrate third-party services.
• Manage and maintain databases using MySQL.
• Perform system and server maintenance on Linux/Unix environments.
• Use Shell scripting to automate routine tasks and deployments.
• Work with the ELK stack (Elasticsearch, Logstash, Kibana) for logging and monitoring.
Qualifications:
• BE/B.Tech in Computer Science/Information Technology/Electronics and Communications
• 3-5 years of proven experience as a Software Developer working with LAMP Stack
• Proficient in PHP, and MySQL.
• Solid experience with Linux/Unix environments, including command-line proficiency.
• Knowledge of Shell Scripting and basic system automation.
• Familiarity with ELK Stack for application monitoring and logging.
• Strong understanding of web protocols, API integration, and database optimization.
• Experience with version control systems like Git.
• Ability to work in an Agile environment and manage multiple tasks efficiently.
Nice to Have:
• Experience with other Python frameworks besides Flask.
• Knowledge of cloud platforms (AWS, Google Cloud) for deploying and scaling applications.
• Familiarity with containerisation technologies like Docker.
Benefits:
• Competitive salary and performance bonuses.
• Medical and insurance coverage.
• Opportunities for professional development and growth.
• Flexible working hours and remote working options.
LogiNext is looking for a technically savvy and experienced senior developer to lead development efforts. You will help the team grow in size and skills, optimizing their code while working on your own. You will design, and develop the products that exceed client expectations in terms of value and benefit. You will collaborate on scalability issues involving access to massive amounts of data and information.
You have hands-on experience in building secure, high-performing and scalable systems in Java. Your design intuition inclines towards usability, elegance and simplicity. You are biased towards open-source tools and existing frameworks. You have successfully shipped applications with beautiful front-end and intelligent backend. You have demonstrated strong interpersonal and communication skills.
Responsibilities
Design and development efforts for high-volume, low-latency applications for real-time event based systems Deliver high-availability and high-performance platform using microservices architecture Identify bottlenecks and inefficiencies in code, and devise solutions to production and non-production issues Keep an eye out for open source projects and technology trends that can be introduced in the products Transform business functionalities and production specifications into technical requirements and low level design Be hands-on, adopt a practical approach to software and technology Work with product management and other teams to build highly scalable products
Requirements
Bachelor’s degree in Computer Science, Information Technology or a related field 2+ years of design and development experience in scalable and distributed enterprise applications using Java/J2EE, JPA, Spring framework and RESTful web services Excellent coding skills in Java Experience in managing, implementing and optimizing big data stores such as MySQL, MongoDB, Elasticsearch Experience in deploying applications and using various managed services provided by cloud platforms (AWS, Azure) Experience in front-end technologies HTML5, CSS3, jQuery, AngularJS and D3.js is preferred Strong foundation in computer science, with strong competencies in data structures, algorithms and software design Proven ability to drive large scale projects with deep understanding of Agile SDLC, high collaboration and leadership
Interested candidates can apply in the link below.
Intellipaat is a global online professional training provider. We create courses for professional career growth with high outcome results on top technologies like Big Data, Data Science & AI, Business Intelligence, Cloud, Blockchain, Database, Programming, Testing, Project Management, etc. We help professionals to help into their dream job by providing world class training & learning experience. Intellipaat world with top MNC’s like NASDAQ, Society Generale, Ericsson, etc. in upskilling their workforce and keeping them in sync with the changing technology and digital landscape.
Job Location - Bengaluru,karnataka (Work from Office)
Responsibilities Include:
● Calling the leads provided in the CRM and understanding their requirements of career up-skilling and pitch the right course as per their needs.
● Consistently achieve revenue targets in line with team/organizational objectives.
● Proactively identifying cross-selling/up-selling opportunities with existing customers.
● Identifying references through the existing customer base to increase the sales pipeline.
● Should be maintaining all customer interactions in the CRM.
● Should have decent exposure working with any CRM like Salesforce, Zoho, etc.
● Managing all pre-sales to post-sales support activities for the assigned leads.
● Follow up on leads and conduct research to identify potential prospects.
● Consistently achieve revenue targets in line with team/organizational objectives.
● To understand customer requirements in the geography assigned and future product portfolio improvement based on past customer feedback.
Skills Preferred:
. Candidates should have at least 1 years of Inside sales experience US shift (Edtech preferred)
. Candidate must have experience in US shift.
∙ Excellent spoken and verbal skills.
∙ Ability to plan and execute.
∙ Ability to persuade and negotiate.
∙ Ability to work under stress.
∙ Ability to work in a team.
∙ Fast-learner, keen on details, and self-motivated
Roles and Responsibilities :
- Design and implementation of the overall web architecture
- Pixel-perfect implementation and integration of our approved user interface
- Design and construction of REST API
- Build efficient, testable, and reusable PHP modules
- Design and deployment of database
- Integration of data storage solutions including various databases, blob stores, key-value pairs, etc.
- Solve complex performance problems and architectural challenges
- Ensuring the entire stack is designed and built for speed and scalability
- Design and implementation of continuous integration and deployment
- Handle overall website deployment and build process
- Work closely with different stakeholders to both develop detailed specification documents with clear project deliverables and timelines, and to ensure timely completion of deliverables.
- 3-5 years of experience in web development and coding within a cross-disciplinary environment
- Good at writing HTML, CSS,Bootstrap and JavaScript. Being up on the latest practices is a must, e.g., HTML5, CSS3, and ECMAScript 6 (minimum)
- Good experience in JQuery, JavaScript
- Must have exp. on PHP, MYSQL, MVC, Linux, logging, Unit testing, Subversion, Restful/soap
- Experience with Source Control tools (Subversion
- Expert in back-end programming language PHP with Laravel framework and IDE
- Good experience in JQuery, JavaScript.
- ReactJS, AngularJS or VueJS would be preferred
- Experience with Source Control tools (Subversion)
- Ideally, familiarity with CSS preprocessors, bundlers, and associated languages/ syntaxes/ libraries
- Database design and management with No-SQL, Mysql, including being up on the latest practices and associated version
- Familiarity with databases (e.g. MySQL, MongoDB), web servers (e.g. Apache) and UI/UX design
- Excellent communication and teamwork skills
- Familiarity with a relevant and globally supported framework both front-end and back-end
- Thorough understanding of user experience and possibly even product strategy
- Experience implementing testing platforms and unit tests
- Proficiency with version control system preferred Git
- Appreciation for clean and well-documented code
- Experienced in full web development life cycle from requirements gathering to Server management and deployment for the relevant environment
- WordPress Experience is a plus.
- Understanding of SEO principles.
Designation: Associate, Senior Asociate
Experience: 3 to 6, 6 to 9
Skills:
Looking for candidate with full stack development experience.
Required Skills:
Dot Net Programming-C# .Net,MS SQL Server,ASP.NET MVC Domain Skills-
Dot Net Framework,WCF,ASP.NET,ANSI SQL,ADO.NET,.Net Programming-VB .Net, Technology .NET
Introduction
http://www.synapsica.com/">Synapsica is a https://yourstory.com/2021/06/funding-alert-synapsica-healthcare-ivycap-ventures-endiya-partners/">series-A funded HealthTech startup founded by alumni from IIT Kharagpur, AIIMS New Delhi, and IIM Ahmedabad. We believe healthcare needs to be transparent and objective while being affordable. Every patient has the right to know exactly what is happening in their bodies and they don't have to rely on cryptic 2 liners given to them as a diagnosis.
Towards this aim, we are building an artificial intelligence enabled cloud based platform to analyse medical images and create v2.0 of advanced radiology reporting. We are backed by IvyCap, Endia Partners, YCombinator and other investors from India, US, and Japan. We are proud to have GE and The Spinal Kinetics as our partners. Here’s a small sample of what we’re building: https://www.youtube.com/watch?v=FR6a94Tqqls">https://www.youtube.com/watch?v=FR6a94Tqqls
Your Roles and Responsibilities
The Application Manager is responsible for building and growing the Synapsic's radiology AI platform - Radiolens. The Application Manager works with product managers and team to create designs for various components of the application, to meet the application’s goals of providing fast and seamless radiology reporting while maintaining scale and extensibility. The Application Manager works with a team of engineers to build these components and owns the end-to-end delivery. The role requires an understanding of various technology choices and a deep understanding of Javascript, React, Nodejs, Mongodb, Python technologies to make right tools and technology choices and then create modules and programs using those technologies.
This is a highly visible role working directly with founders and requires a mix of technical acumen and team leadership skills to drive the execution of the platform. This person must be creative, ask questions, and be comfortable challenging the status quo. The position is based in our Bangalore office.
Primary Responsibilities
- Own end-to-end application development
- Work along with product managers and teams to ideate, execute and deliver end-to-end software solutions.
- Design, build and develop full stack apps with microservices.
- Ensure analysis, efficiency, responsiveness, scalability and cross-platform compatibility of applications through captured metrics, testing frameworks, and debugging methodologies.
- Collaborate with Artificial Intelligence, data and other teams to integrate other products with the application
- Technical documentation through all stages of development
- Create design, develop modules, and coordinate efforts with the development team, working on application architectural implementation
- Guide and manage development team on all deliverables, including technical design, logical and physical design of the solution, coding, testing, and debugging
- Collaborate with Product Analysts and Product Managers to estimate and plan work and provide status updates to stakeholders
- Create a close working relationship with business partners to identify the pain points and provide better experience to clients
- Establish strong relationships, and proactively communicate, with team members as well as individuals across the organisation
Requirements
- Degree in Computer Science or related discipline with 6-10 years of experience.
- Proficiency with server side languages such as Nodejs, Python, shell scripting
- Hands on with Reactjs or similar framework/library.
- Proficiency with at least one no-sql database such as MongoDB.
- Experience with platform components and REST APIs, to define platform interfaces and boundaries
- Experience creating a loosely coupled, services oriented design that can scale for large volumes of data
- Experience supporting extensibility, to plug new modules or services without requiring re-design
- Expertise in object oriented programming and applying OO principles patterns
- Good command over CI/CD processes.
- Excellent communication and collaboration skills with project members and stakeholders.
- Good problem solving skills.
- Detail-oriented, eager to learn, acquire new skills
- Very high sense of ownership.
- Deep interest and passion for technology
- Prior experience of leading software teams
- Ability to plan projects, execute them and meet the deadline
Description
Experience: 1.5 to 3 yrs
* Hands on work experience developing in Java and J2EE
* Hands on work experience developing in JavaScript
* Extensive working experience in Springboot
* Good to have No SQL (Mongo DB) and My SQL Exposure
* Good to have experience in AWS cloud environment
* Designing, developing, troubleshooting and debugging software within a project scope ensuring that work product meets end user acceptance criteria.
* Managing self-directed assignments to resolve software defects or implement features to meet schedule commitments with a high-level of quality.
* Acquiring knowledge of industry and company standards, tools and technology with a focus on pragmatic application to business-focused software solutions through initiative and self-study
Requirements
Primary Skill Java Springboot, Java Script
Good to have Mongo Db (No Sql), My SQL and Exposure to AWS
Benefits
Salary:300000 LPA to 500000 LPA
- Hands-on programmer with ability to write idiomatic code in Java
- Strong preference to write automated unit & integration tests
- Prior experience in designing & deploying Microservices and performant REST APIs
- Good understanding of and experience in Continuous Integration / Continuous Delivery
- Hand-on experience using one of the server-side Java frameworks such as Spring Boot
- Excellent communication skills
Nice to have
- Experience working with AWS or other Cloud providers
- Experience working in Event-Driven systems (using Apache Kafka or something similar)
- Exposure to Angular or React