
Big Data Engineer
at Altimetrik
Experience in developing lambda functions with AWS Lambda
Expertise with Spark/PySpark – Candidate should be hands on with PySpark code and should be able to do transformations with Spark
Should be able to code in Python and Scala.
Snowflake experience will be a plus

Similar jobs
Work Mode: Hybrid (2 days WFO)
We are looking for a Data Engineer who is a self-starter to work in a diverse and fast-paced environment within our Enterprise Data team. This is an individual contributor role that is responsible for designing and developing of data solutions that are strategic for the business and built on the latest technologies and patterns,regional and global level by utilizing in-depth knowledge of data, infrastructure, technologies and data engineering experience.
Responsibilities
· Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements
· Develop systems that ingest, cleanse and normalize diverse datasets, develop data pipelines from various internal and external sources and build structure for previously unstructured data
· Interact with internal colleagues and external professionals to determine requirements, anticipate future needs, and identify areas of opportunity to drive data development
· Develop good understanding of how data will flow & stored through an organization across multiple applications such as CRM, Broker & Sales tools, Finance, HR etc
· Unify, enrich, and analyze variety of data to derive insights and opportunities
· Design & develop data management and data persistence solutions for application use cases leveraging relational, non-relational databases and enhancing our data processing capabilities
· Develop POCs to influence platform architects, product managers and software engineers to validate solution proposals and migrate
· Develop data lake solution to store structured and unstructured data from internal and external sources and provide technical guidance to help migrate colleagues to modern technology platform
· Contribute and adhere to CI/CD processes, development best practices and strengthen the discipline in Data Engineering Org
· Mentor other members in the team and organization and contribute to organizations’ growth.
Soft Skills
· Independent and able to manage, prioritize & lead workloads
· Team player, Reliable, self-motivated, and self-disciplined individual capable of executing on multiple projects simultaneously within a fast-paced environment working with cross functional teams
· Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Technical Skills
· 8+ years’ work experience and bachelor’s degree in Information Science, Computer Science, Mathematics, Statistics or a quantitative discipline in science, business, or social science.
· Hands-on engineer who is curious about technology, should be able to quickly adopt to change and one who understands the technologies supporting areas such as Cloud Computing (AWS, Azure(preferred), etc.), Micro Services, Streaming Technologies, Network, Security, etc.
· 5 or more years of active development experience as a data developer using Python-spark, Spark Streaming, Azure SQL Server, Cosmos DB/Mongo DB, Azure Event Hubs, Azure Data Lake Storage, Azure Search, Azure Data factory and Azure synapse analytics, Git Integration with Azure DevOps, etc.
· Experience with designing & developing data management and data persistence solutions for application use cases leveraging relational, non-relational databases and enhancing our data processing capabilities
· Experience with building, testing and enhancing data curation pipelines and integrating data from a wide variety of sources like DBMS, File systems, APIs and streaming systems for various KPIs and metrics development with high data quality and integrity
· Experience with maintaining the health and monitoring of assigned data engineering capabilities that span analytic functions by triaging maintenance issues; ensuring high availability of the platform; monitoring workload demands; working with Infrastructure Engineering teams to maintain the data platform; serve as an SME of one or more application
· 3+ years of experience working with source code control systems and Continuous Integration/Continuous Deployment tools
TVARIT GmbH develops and delivers solutions in the field of artificial intelligence (AI) for the Manufacturing, automotive, and process industries. With its software products, TVARIT makes it possible for its customers to make intelligent and well-founded decisions, e.g., in forward-looking Maintenance, increasing the OEE and predictive quality. We have renowned reference customers, competent technology, a good research team from renowned Universities, and the award of a renowned AI prize (e.g., EU Horizon 2020) which makes TVARIT one of the most innovative AI companies in Germany and Europe.
Requirements:
- Python Experience: Minimum 3+ years.
- Software Development Experience: Minimum 8+ years.
- Data Engineering and ETL Workloads: Minimum 2+ years.
- Familiarity with Software Development Life Cycle (SDLC).
- CI/CD Pipeline Development: Experience in developing CI/CD pipelines for large projects.
- Agile Framework & Sprint Methodology: Experience with Jira.
- Source Version Control: Experience with GitHub or similar SVC.
- Team Leadership: Experience leading a team of software developers/data scientists.
Good to Have:
- Experience with Golang.
- DevOps/Cloud Experience (preferably AWS).
- Experience with React and TypeScript.
Responsibilities:
- Mentor and train a team of data scientists and software developers.
- Lead and guide the team in best practices for software development and data engineering.
- Develop and implement CI/CD pipelines.
- Ensure adherence to Agile methodologies and participate in sprint planning and execution.
- Collaborate with the team to ensure the successful delivery of projects.
- Provide on-site support and training in Pune.
Skills and Attributes:
- Strong leadership and mentorship abilities.
- Excellent problem-solving skills.
- Effective communication and teamwork.
- Ability to work in a fast-paced environment.
- Passionate about technology and continuous learning.
Note: This is a part-time position paid on an hourly basis. The initial commitment is 4-8 hours per week, with potential fluctuations.
Join TVARIT and be a pivotal part of shaping the future of software development and data engineering.
- Work as a Senior Developer or Tech Lead for blockchain-based projects.
- Lead small development teams (3-5 people).
- Work in Agile/Scrum teams.
- Deliver quality solutions to customers by implementing relevant tools/ frameworks/ libraries in Hyperledger.
- Experience in the role of a senior developer/tech lead for blockchain and non-blockchain-based projects. (At least 3 to 5 projects)
- Hands-on experience with Enterprise Blockchain platforms (particularly Hyperledger ONLY) and a good awareness of others, to evaluate and drive the selection of the right platform for the area of implementation.
- Must be well versed with software design and development methodologies for web application development using Java/Java EE/Open Source or Microsoft .NET technologies.
- Mandatory experience in implementing Blockchain applications/projects using MEAN/MERN/Java/Go technology stack, Git, Linux/ Ubuntu/ MacOs/ Windows/ Virtual machines.
- Understanding of smart contracts and experience in developing smart contracts (Node/ JavaScript/ Go/ Java) for at least 2 live projects.
- Knowledge of design considerations, best practices, and standards for designing smart contract-based solutions for decentralized applications.
- Understanding of common tools/ frameworks/ libraries used for quality software development and Blockchain implementation, including those for Hyperledger.
- Knowledge of common architecture patterns for applications (MVC, SPA), cloud, data storage, security, API/Integration, serverless architectures, etc.
- Experience in using (and configuring) CI/CD pipelines (and know-how of DevOps) for blockchain projects.
- Experience in leading small development teams (3-5 people) and should have worked in Agile/Scrum teams.
- Strong verbal and written communication skills; must be comfortable with client and stakeholder interactions.
- Good understanding of IPFS and IPNS protocols.
- Interest to learn and apply learning to design and implement blockchain solutions
- Record of publication of good quality blogs and papers.
- Completion of relevant certifications: Blockchain developer, Java EE / Web Application Developer, Cloud Certification, etc.
About us:
Zemoso Technologies is a Software Product Market Fit Studio that brings silicon valley style rapid prototyping and rapid application builds to Entrepreneurs and Corporate innovation. We offer Innovation as a service and work on ideas from scratch and take it to the Product Market Fit stage using Design Thinking->Lean Execution->Agile Methodology.
We were featured as one of Deloitte Fastest 50 growing tech companies from India thrice (2016, 2018 and 2019). We were also featured in Deloitte Technology Fast 500 Asia Pacific both in 2016 and 2018.
We are located in Hyderabad, India, and Dallas, US. We have recently incorporated another office in Waterloo, Canada.
Our founders have had past successes - founded a decision management company acquired by SAP AG (now part of Hana Big data stack & NetWeaver BPM), early engineering team of Zoho (leading billion $ SaaS player) & some Private Equity experience.
Marquee customers along with some exciting start-ups are part of our clientele.
What You Will Do
● Create beautiful software experiences for our clients using design thinking, and lean and agile methodology.
● Work on world-class software products using the latest cutting-edge technologies and platforms.
● Work in a dynamic, collaborative, transparent, non-hierarchical culture.
● Work in collaborative, fast-paced, and value-driven teams to build innovative customer experiences for our clients.
● Help to grow the next generation of developers and positively impact the industry.
Basic Qualifications
● Experience: 5+ years
● Hands-on development experience in backend, Java, SpringBoot, Hibernate, SQL, MongoDB, Jenkins, Microservices, etc.
● Server-side development experience mainly in JAVA.
● Passion for software engineering and following the best coding concepts.
● Good to great problem-solving and communication skills.
● Experience in working with cross-border, distributed teams is a must. Nice to have Qualifications ● Product and customer-centric mindset
● Great OO skills, including design patterns.
● Experience with large-scale enterprise systems Get to know us better: https://www.zemosolabs.com.
Client's Overview
BANKIT Services Private Limited is an assisted B2C company. The vision of the company is to make “Millionaire Agents Network” (MAN) i.e. to maximize the number of agents who are able to make Rs. 10L as revenue in a year by delivering various BANKIT services. We are going towards our target of opening BANKIT outlets and KIOSKS at every city, every village even in remote areas of country to experience all the citizens the easiest, fastest & safest Digital payment platform and all the Digital services under one roof. In order to serve the under digital and under banked population in India, we have prepared an assisted agent led model which works to offer digital and financial services to the last mile. Banking and financial services along many value-added services are available for end customers through BANKIT channel partners in their neighborhood. Services like Domestic Money transfer, Cash Withdrawal, Prepaid Cards, Recharges, Bill Payments, Travel Bookings etc. are made available 24X7 through our proprietary web and mobile applications. These applications are made very user friendly as per the needs of the target users and are built using the state-of-the-art technology to make the transactions secure and instant.
- Founded- 2010
- Specialties - Domestic Money Transfer, Travel & Stay, Prepaid Cards, UPI, AEPS, BBPS, QR Code, Cash @ POS, Agent Mobile App, Money Remittance, Blockchain, Micro ATM, E-KYC, Merchant Network, FinTech Company, Digital India, and PAN CARD Center
About Role:
Full Stack Developer/Software Developer
Experience: 1+ years
Salary bracket- Industry Fit
- Contribute to all phases of the development lifecycle
- Front-end technology: Expertise in front-end technologies, including JavaScript and HTML5 and third-party libraries such as Angular, jQuery.
- Development languages: Knowledge of server-side programming languages including Java, spring boot.
Position Summary:
The Oracle EDM/DRM Associate is responsible for delivery of Oracle Enterprise Data Management Cloud (EDM) and Data Relationship Management (DRM) consulting projects and shows a demonstrated propensity of technical and functional proficiency in the design and development of enterprise-wide master data applications.
The Oracle EDM/DRM Associate will also:
- Build and deploy master data solutions for Huron client engagements
- Build and deploy data governance procedures for Huron client engagements
- Work effectively on a team with Huron leadership and peers as well as client personnel
Qualifications:
- 1-6 years of design, implementation, and support of master data management applications and familiarity with ERP/EPM/BI applications
- Bachelor's Degree in Computer Science/Management, Information Systems, Business Administration or equivalent
- Experience with Oracle Enterprise Data Management (EDM) or Oracle Data Relationship Management/Data Relationship Governance (DRM/DRG)
- Familiarity with Oracle ERP, EPM or BI applications and Oracle integration methodologies
- Knowledge of business workflows and change processes
- Knowledge of data governance concepts and master data management best practices
Additional Preferred Skill Requirements:
- Has successfully participated in large-scale MDM and Enterprise Performance Management or Enterprise Resource Planning solutions
- Has experience working with REST APIs, Oracle Data Management (Cloud/FDMEE), Oracle Integration Cloud (OIC), PowerShell, Groovy
- Has strong presentation and collaborative skills and can communicate all aspects of the job requirements, including the creation of formal documentation/deliverables
- Excellent analytical and problem-solving skills
- Excellent organizational, time-management, and communication skills
• Location:- C.G Road, Ahmedabad
• Working days:- 5 days, 2 Saturday alternate holidays.
• Experience:- Mini. 8yrs
Job Description:-
We are looking for a Software Architect to drive technology strategy, create the
technological vision and to ensure the designing and development of software solutions that fulfils the business requirements. You will be a key contributor to architectural decisions for products, drawing on your excellent technical, analytical and business acumen skills while effectively communicating with all levels in the organization to build high scalable and secure solutions.
KRA:-
Articulate architecture & Non functional requirements for the products and service with high precision. Gathering business requirements to analyse, identify, design and innovate solutions.
• Device strategy to implement NFRs
• Validate the design, development to confirm against the architecture and NFR
• Technical owner of the IT Projects
• Design and develop best practises in software development and architecture together with the team.
• Determining overall architectural principles, frameworks and standards.
• To provide hands-on development wherever appropriate specially on architecture transformation projects.
• Involve in unit testing, code reviews and bug fixing.
• Driving research, case studies on how latest technologies could be leveraged for software architecture and capabilities such as scalability, fault tolerance, extensibility, maintainability, etc.
• Documenting designs, estimates and implementation plans to iAND stakeholders.
Requirement:-
• Academics exposureExperience in architecting and designing technical solutions especially in area of mobile and cloud. for SaaS capabilities.
• Ability in scaling products and to tackle large traffic and amounts of data.
• Academics expertise in coding, programming and software design patterns.
• Passionate about technology and constantly growing your technical expertise.
Great to Have:-
• Professional Coding proficiency in Python and JavaScript. certifications like AWS, MS Azure
• Experience in insurance domain
Responsibilities:
- The candidate will be engaged in program management support functions such as logistics, coordination of arrangements for conferences, workshops and continuing education programs, maintenance of archives for programs conducted and database management.
- Plan and develop a database of outsourcing service providers for multi-media design,brochure preparation, conference materials and printing.
- Maintain database of addresses for various purposes of mailing.
- Maintain a library of documents, records and books for ready reference with proper indexing and file management.
- Coordinate visit of important domestic and overseas visitors, plan their itinerary, coordinate with travel agencies, transport service providers and hotels.
- Maintain a database of various hospitality service providers and develop institutional relationship with such service providers for conduct of executive development programs.
- Develop drafts for event related correspondence.
- Coordinate inter-office meetings, prepare minutes of inter-office meetings and Under take follow-up actions as per the instructions of the Directors and Senior Managers.
Candidates Profile:
- A computer literate with proficiency in MS Office and Internet usage.
- The prospective candidate should have good communication skills.
- A Pleasing Personality with right attitude and a burning desire to excel.
- Willingness to travel.









