Lead Data Engineer

Title:- Senior Data Engineer 

Experience: 4-6 yrs

Budget: 24-28 lpa

Location: Bangalore 

Work of Mode: Work from office

Primary Skills: Data Bricks, Spark, Pyspark,Sql, Python, AWS

Qualification: Any Engineering degree

Responsibilities:

∙Design and build reusable components, frameworks and libraries at scale to support  analytics products. 

∙Design and implement product features in collaboration with business and Technology

 stakeholders. 

∙Anticipate, identify and solve issues concerning data management to improve data   quality.

∙Clean, prepare and optimize data at scale for ingestion and consumption.

∙Drive the implementation of new data management projects and re-structure of the   current data architecture.

∙Implement complex automated workflows and routines using workflow scheduling tools. 

∙Build continuous integration, test-driven development and production deployment

 frameworks.

∙Drive collaborative reviews of design, code, test plans and dataset implementation  performed by other data engineers in support of maintaining data engineering  standards.

∙Analyze and profile data for the purpose of designing scalable solutions. 

∙Troubleshoot complex data issues and perform root cause analysis to proactively resolve

 product and operational issues.

∙Mentor and develop other data engineers in adopting best practices.

Qualifications:

Primary skillset:

∙Experience working with distributed technology tools for developing Batch and  Streaming pipelines using 

  o SQL, Spark, Python, PySpark [4+ years],

  o Airflow [3+ years],

  o Scala [2+ years].

∙Able to write code which is optimized for performance.

∙Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.

∙Able to quickly pick up new programming languages, technologies, and frameworks.

∙Strong skills building positive relationships across Product and Engineering.

∙Able to influence and communicate effectively, both verbally and written, with team  members and business stakeholders

∙Experience with creating/ configuring Jenkins pipeline for smooth CI/CD process for  Managed Spark jobs, build Docker images, etc.

∙Working knowledge of Data warehousing, Data modelling, Governance and Data   Architecture

Good to have:

∙Experience working with Data platforms, including EMR, Airflow, Databricks (Data

 Engineering & Delta Lake components, and Lakehouse Medallion architecture), etc.

∙Experience working in Agile and Scrum development process.

∙Experience in EMR/ EC2, Databricks etc.

∙Experience working with Data warehousing tools, including SQL database, Presto, and

 Snowflake

∙Experience architecting data product in Streaming, Serverless and Microservices  Architecture and platform.

About the company:

Company is building a math-learning platform with a meticulously designed curriculum that helps students become 4x quicker and better at math by nurturing their cognitive abilities and building their core math acumen.

Responsibilities:

• Lead technical direction, delivery and execution of technology roadmap, geared towards our overall vision
• Provide senior technical leadership at the highest levels in strong engineering culture
• Experience developing desktop and mobile applications
• Manage a team of around 10 engineers at various level of experience
• Experience working with Product Managers and UX Designers
• High level of maturity in delivery management in terms of project planning, execution, quality and stakeholder expectation management
• Regularly review team performance, collaborate with them on improvement initiatives/experiments and understand the data, team and workflow
• Attract, recruit, retain, and develop top engineering talent
• Foster a culture of risk taking and be able to celebrate failures
• Lead accountability, autonomy, and empowerment within your teams and manage the appropriate boundaries to achieve the result of having self-directed work teams

We are looking for a passionate Solutions Architect with a diverse backend technology background to lead large engineering teams at Simform. You should have a good understanding of software architecture design, backend technologies, and cloud platforms and have experience leading a team of developers.

Role + Responsibilities:

• Designing, modifying, and testing technical architecture.
• Helping project teams with solutions architecture, troubleshooting, and technical implementation assistance. 
• Occasionally working as a Tech Lead if the situation demands
• Use your expertise in different tech-stack/languages, tech architecture, etc., to drive improvements in the accuracy, quality, the efficiency of projects. 
• Advocating for process improvements and helping develop solutions.
• Providing technical leadership to a team throughout the project lifecycle.
• Oversee project teams' work and provide assistance for any troubleshooting or technical implementation guidance. 
• Ensure standards and best practices are implemented and practiced by large cross-technical teams.
• 
  

Person Specification and Qualifications:

• Technical background with over 10 years dabbling into multiple technologies and grasping crux of them.
• Significant hands-on experience with Node/Python 
• Experience in building reliable, robust, secure, and high-performance in-production software systems with a large user base. 
• Strong understanding of Cloud (Preferably AWS) and conceptual understanding of CI/CD, and DevOps. 
• Strong interpersonal skills including mentoring, coaching, collaborating, and team building.
• Creative approach to problem-solving with the ability to focus on details while maintaining the “big picture” view
• Exposure and expertise in design patterns and software design patterns in general

One of our premium-based customers, we are looking to hire a team of Azure .Net Architects in Bangalore/Pune/Noida, looking for Tech Geeks, who have 14+ years of experience full-time.

PFB the JD: Proven Full Stack development skills and have solid business acumen and hands-on experience in architecting solutions

-14+ years Exp

-Expertise in designing and developing Cloud Native applications using Azure Services and managing IaC using Terraform modules and ARM templates

 -Cloud Technologies: Azure Services(-(Paas Services, At least experience in some of the services is good enough - Logic Apps, API Management Service, Microsoft Graph API, Azure AD, Azure functions, Cosmos db(mongo db API), Event hub, Stream Analytics, Azure SQL Server, Azure storage table, Azure Storage Queue, Azure blob storage, Azure Event grid, Azure App Service, Application Insights, Azure ARM templates, Azure Worker Roles, Azure web jobs, Azure Relay services, Azure KeyVault, Azure App Services, Logic Apps)

- App Service, Azure Functions, VMs, ASF, AKS, Azure Container Registry, Key Vault, Cosmos DB, Azure SQL, Azure AD, Azure B2C and B2B, APIM, Azure Monitor and App insight

-Containerization tools: Docker, Azure Kubernetes Services, Azure Container Registry

-Infrastructure as Code tools: Terraform, and ARM templates

-DevOps tools: Azure DevOps, CI/CD using Git and Azure Pipeline, Azure Repos

-Microsoft Technologies: ASP.NET Core, .NET Core Web API, .NET, ASP.Net MVC, ADO.Net, TPL, LINQ, PLINQ, WCF Services, ASP .Net Web API, Angular

-Databases: NoSQL/document Databases Azure Cosmos DB, Oracle

 -Strong experience in SQL -Experience in Integration or service layer is recommended

Job Description:

As a developer in the chatbot team you’ll be responsible for expanding the scope of AERIN (Aertrip’s Chatbot) to handle all types of travel queries in a scalable and efficient manner. You will need to make AERIN as robust as possible and strive towards 100% accuracy. You should be able to design, develop, test and roll out new features quickly. You should be ready to tackle open-ended problems and build solutions for them.

Preferred qualifications & experience:

1. Bachelor’s degree in Computer Science or equivalent experience.
2. 1 or more years of work experience in the tech industry.
3. Experience with NLP solutions.
4. Experience with chatbot frameworks like RASA, DialogFlow is a bonus.
5. Experience with spacy, nltk and other ML libraries.
6. Familiarity with version control tools like Gitlab.
7. Experience in object oriented design and programming.
8. Sound programming skills to write algorithms for text analysis and context understanding.

Preferred Skills & Abilities:

1. Should be able to write clean and manageable code.
2. Passion for innovation.
3. Out of the box thinking.
4. Should be able to understand both the tech and business aspects of a system.
5. Should be able to meet deadlines.
6. Should be able to work in a collaborative environment.
7. Should be able to work independently in small teams.

This person MUST have:
 

• B.E Computer Science or equivalent
• Cloud architect with hands on development background.
• Build a collaborative relationship with different stakeholders
• Experience on React JS and Python Programming
• Exposure to Python/Django +  NodeJS + ReactJS
• Ensure and drive completions of all committed tasks and deliverables
• Run daily stand-ups and bring teams into an agile cadence of frequent iterations
• Increase team productivity by removing obstacles and keeping processes lean.
• Able to prioritise different tasks and communicate it to the different verticals of the organisation.
• Regularly assess risks and opportunities; understand best practices, drive for process improvements, and find new ways of operating,
• with a focus on simplification and productivity.
• Excellent written and oral business communication and people skills
•  

Experience:

• Min 7 year experience
• Not more than 15 year experience.
• Startup experience is a must. 

Location:

• Remote 

Timings:

• 40 hours a week but with 4 hours a day overlapping with client timezone.  Typically clients are in California PST Timezone.

Position:

• Full time/Direct
• We have great benefits such as PF, medical insurance, 12 annual company holidays, 12 PTO leaves per year, annual increments, Diwali bonus, spot bonuses and other incentives etc.
• We dont believe in locking in people with large notice periods.  You will stay here because you love the company.  We have only a 15 days notice period.

Who We Are

We build innovative technology everyday!

Crediwatch is a ‘Data Insights-as-a-service’ company that provides lenders, businesses with actionable credit intelligence on private entities they need to improve trust and increase their lending and trading activity. Crediwatch is in the business of extracting valuable insights by applying artificial intelligence and deep learning and delivering them to chief decision makers. We believe in zero human touch and building systems to augment human intelligence. We do this by deploying the latest practical AI and technology tools that provide the most reliable comprehensive real time inputs.

Each day at Crediwatch is about striving for transparent insights, analysis and accurate results. If this aligns with your interests and aspirations, we have interesting positions for you.

For more information, please visit www.crediwatch.com

The Role Expectation

We are seeking a Technical Project Manager who is passionate about building technology that solves Credit problems and creating experiences that are elegant and effective. You will own, drive and create world-class user experiences throughout the lifecycle. You will serve as a product owner within an agile, cross-functional team of operations and engineers to work on the most impactful features. You are user-centric, continuously demonstrate strategic & analytical abilities, and are laser focused on executing at speed. In this role, you will partner with diverse cross-functional teams to lead, execute, monitor, and deliver results. You must have the ability to succeed in a fast-paced environment, where success is dependent on your ability to collaborate with cross-functional partners in a positive, productive, and transparent way.

Responsibilities

• Understand CW'S strategic position to deliver features
• Drive product development to build end to end solutions with a team of engineers and designers.
• Serve as a product owner and work with the Product managers to write user stories, prioritize the product backlog, and work closely with engineers to deliver a good product
• Work with UX to analyze current user experiences to define friction points and create seamless and effortless experiences
• Develop a product roadmap and work with cross-functional teams (business, operations, development, UX, analytics) to execute on the roadmap
• Track the task and utilization of the engineers on the team
• Work with the Architect to ensure that a high performance and highly scalable system is engineered
• Apply analytics to evaluate launch outcomes and ongoing platform performance to help build best in class experiences.
• Ensure that best practices and standards are inculcated and ownership is properly delegated within the team
• Bring in the best Agile practices and ensure code quality and code coverage

You Have:

• Bachelor's degree in engineering preferably CS or related discipline
• 5+ of experience in SaaS based product development for the web as well as mobile devices with experience on applications using Python, React and NoSQL, SQL, Search technologies, etc.
• 3+ of technical project management driving end to end implementation from defining user stories to testing and deployment of features
• Strong ability to translate product needs to technology and understand technology.
• Detail-oriented, unfazed by technical detail, committed to flawless execution
• Ability to think out of the box to solve problems
• Ability to participate in technical discussions and help make technical trade-offs
• Excellent verbal and written communication skills; clarity of thought; Team player; ability to interface and build relations at all levels

Good to Have:

• Experience developing customer facing products, technologies and platforms
• Entrepreneurial drive and demonstrated ability to achieve stretch goals in an innovative and fast-paced environment
• Strong technical leadership, project management, analytical problem solving, and troubleshooting skills
• Ability to collaborate, build consensus, deliver, and drive technical decisions with various sized customer stakeholder groups

You Believe-in & will align with our Business Objectives

• Customer Obsession - Consistently listen to customers; test, enhance and improve the customer experience.
• Breakthrough Simplicity - An innovative approach to make everything simpler
• Diving Deep -Technique used to arrive at a solution-based approach to problem solving and idea creation
• Drive for Results - Focus on end result of any task
• Encourage and Improve - Encouraging and promoting teamwork and focus on continuous self-development at every stage.
• Be Ethical and Respectful - Willingness to do the right thing – even if it is hard; courteousness and being focused on the best in others.

You Will Enjoy

Our start-up environment - fun, casual, informal, family & pet-friendly! Ours is a highly energized playground where brilliant minds come together to make bold, impactful decisions every day! Needless to say, we have excellent filter coffee and health drinks round the clock, lunch buffets, PS4 and Foosball breaks and a stocked kitchen.

We play to win and have fun doing it! We work to engage your brain by organizing brilliant TechTalks by industry leaders and frequent high-on-energy hackathons and engage your crazy fun-side at our well-planned retreats. We are a highly eco-conscious team and we encourage and support our team’s physical & mental wellbeing.

All these and a great set of people to work with - We Are Crediwatch!

Azine Technologies is known for our innovative technologies, products and services - and for the people behind them. At Azine, we create identity verification products which are essentially apps, APIs, SDKs which have different modules that undergo OCR, Face Recognition, and other AI and machine learning.

As Project Manager - Software Development you will be responsible for managing engineering and developing cohesive codes with high proficiency in multiple languages and be comfortable on both front end and back end programming.

• Report directly to the CEO
• Lead, motivate, and manage a multidisciplinary IT team.
• Provide coaching, mentoring, performance management, and technical guidance that encourages growth within the team with the ability to manage teams in Ahmedabad.
• Increase the technology aspect of product development throughput 20x.
• Review code, lead technical discussions and promote best practices.
• Guide the team to deliver clean code and architecture and enable the business to scale
• Be able to jump in and lead by example; writing high-quality, highly-testable code.
• Promote lean and agile ways of delivering value through the technology team.
• Be the steward of the company's technology resources and technology spend.
• Creating timelines for the development and deployment of all technological services.
• Integrate the technology element with the company's business partnerships.
• Collaborate with the executive team members on strategic planning and management.
• Provide visibility into the development roadmap, sprints, throughput and expected timelines.
• Develop and design new scalable, loosely coupled and high-performance architecture.
• Work closely with the CEO on effective product management practices.

B.E./B. Tech

6+ years of experience in a digital product development role in a software engineering business

6+ years of experience in Java for a commercial software company.

UX/UI, product development and project management experience.

Understanding of emerging technologies like Artificial Intelligence, Machine Learning, Optical Character Recognition, Anti-Spoofing, etc.

Proven experience in growing markets for technology products & services.

An ability to collaborate internally and externally with business partners.

Self-starter, independent and proactive.

Excellent interpersonal and communication skills.

Java, Python, Artificial Intelligence, Machine Learning, Optical character recognition, Self-organizing maps, Artificial Intelligence (AI), Machine Learning (ML), Computer Vision,

We are offering amazing career growth opportunities, great compensation, and benefits. This begins with: - weekly lunches, alternate weekends-off, annual medical checkups, social engagement, financial assistance and more.

Job Type: Full-time

Office Hours: 10 a.m. to 7 p.m. Mon TO Fri; 9 a.m. to 2.30 a.m. Saturday (alternate Saturdays are off)