Job Description - Sr Azure Data Engineer
Roles & Responsibilities:
- Hands-on programming in C# / .Net,
- Develop serverless applications using Azure Function Apps.
- Writing complex SQL Queries, Stored procedures, and Views.
- Creating Data processing pipeline(s).
- Develop / Manage large-scale Data Warehousing and Data processing solutions.
- Provide clean, usable data and recommend data efficiency, quality, and data integrity.
Skills
- Should have working experience on C# /.Net.
- Proficient with writing SQL queries, Stored Procedures, and Views
- Should have worked on Azure Cloud Stack.
- Should have working experience ofin developing serverless code.
- Must have MANDATORILY worked on Azure Data Factory.
Experience
- 4+ years of relevant experience
About CoStrategix Technologies
Similar jobs
ABOUT THE ROLE:
Job Description:
Overview:
We are in search of a seasoned Technical Lead with expertise in Micro services, Cloud Infrastructure,
API Integrations, Networking, Python, Database technologies, and strong proficiency in DevOps
practices. The ideal candidate will have a minimum of 5+ years of experience, showcasing a
comprehensive skill set and a track record of successful project delivery. This role requires
proficiency in cloud services, a deep understanding of DevOps principles, and experience with
database management. Additionally, cloud migration experience is considered a valuable asset.
Key Responsibilities:
• Technical Leadership:
• Lead and inspire a cross-functional team, providing technical guidance and
support.
• Ensure the successful implementation of technical solutions aligned with project goals and timelines.
• Microservices Architecture:
• Design and implement scalable and modular micro-services architecture.
• Enforce best practices in micro-services development, deployment, and
monitoring.
• Cloud Infrastructure and DevOps:
• Architect, deploy, and manage cloud infrastructure on platforms such as AWS, Azure, or Google Cloud.
• Demonstrate strong DevOps practices to streamline development, testing, and deployment processes.
• API Integrations:
• Develop and integrate APIs for seamless communication between system components.
• Prioritize security and reliability in API integrations.
• Networking:
• Design and implement network solutions for distributed systems.
• Troubleshoot and optimise network performance.
• Programming Skills:
• Proficiency in Python for backend development. Django or flask framework.
• Collaborate with the development team to ensure code quality and
adherence to best practices.
• Database Management:
• Design and optimise database schemas for performance and scalability.
• Experience with both SQL and NoSQL databases.
Mandatory Skills:
• Cloud services expertise any one (AWS, Azure, Google Cloud).
• Strong understanding and application of DevOps principles.
• Database management experience.
Preferred Skills:
• Cloud migration experience.
• Certification in relevant cloud platforms.
• Familiarity with containerisation, CI/CD and orchestration tools (Docker, Jenkins,
Kubernetes).
Qualifications:
• Bachelor's or higher degree in Computer Science, Engineering, or a related field.
• Minimum of 5+ years of experience in a technical leadership role.
• Proven expertise in micro-services architecture, cloud infrastructure, API
integrations, networking, Python, and database technologies.
ABOUT THE COMPANY:
FatakPay Digital Private Ltd (FatakPay) is a digital-only lending platform that provides virtual
credit facilities. The solution provides a 100% digital and paperless quick, transparent and secure
way to transact in multilingual format with a ‘scan now, pay later’ facility and easy repayment
options.
We're a company that strongly believes in teamwork, design, creativity and tech. We love to build
the best possible Financial Tech products that make the world a better place.
WHAT HAPPENS NEXT?
If selected for an interview, you will hear directly from someone from the HR department, usually
within a week of the closing date.
Your Day-to-Day
- Assist our Growth Strategists in analyzing the results of A/B experiments.
- Analysis on customer engagement rates, customer acquisition projects ( ex. Churn rate prediction, Attribution etc. )
- Analyse marketing channel performance and Deep-dive reports to stakeholders and Management
- Building statistical experimentation templates for faster A/B outputs
- Work on forecasting models and assisting senior Management in creating frameworks on growth models
- Local implementation of marketing analytics projects related to improving marketing channels effectiveness, customer segmentation, campaign optimization, etc
- Monitor campaigns against key performance indicators (KPIs), be fully aware of trends and analytics, success and risks in order to achieve business objectives.
- Communicate complex ideas into understandable reports/documentation and this will include leveraging on leading software tools such as Tableau.
Your Know-Know
- 3-5 years of experience in strategy / consulting / analytical / project management roles; experience in e-commerce, Start-ups or Unicorns(CARS24,OLA,SWIGGY,FLIPKART,OYO) or entrepreneur experience preferred + At Least 2 years of experience leading a team
- Top-notch academics from a Tier 1 college (IIM / IIT/ NIT)
- Must have SQL/PostgreSQL/Tableau Experience.
- Added advantage: Experience with Google Analytics, CRM (MoEngage, Braze,Leanplum).
- Preferred knowledge of statistical computer languages (Python / R, etc).
- Analytical mindset with ability to present data in a structured and informative way
- Enjoy a fast-paced environment and can align business objectives with product priorities
Airflow developer:
Exp: 5 to 10yrs & Relevant exp must be above 4 Years.
Work location: Hyderabad (Hybrid Model)
Job description:
· Experience in working on Airflow.
· Experience in SQL, Python, and Object-oriented programming.
· Experience in the data warehouse, database concepts, and ETL tools (Informatica, DataStage, Pentaho, etc.).
· Azure experience and exposure to Kubernetes.
· Experience in Azure data factory, Azure Databricks, and Snowflake.
Required Skills: Azure Databricks/Data Factory, Kubernetes/Dockers, DAG Development, Hands-on Python coding.
Technology Strategy and Innovation:
● Define the company's long-term technology vision and strategy in alignment with business goals.
● Stay abreast of industry trends, emerging technologies, and the competitive landscape to drive innovation and maintain a competitive edge.
● Identify opportunities for technology partnerships, collaborations, and acquisitions to enhance our product offerings.
Product Roadmap and Development:
● Lead the product development lifecycle, from ideation to commercialization, ensuring the timely and successful delivery of AR/VR devices.
● Collaborate with cross-functional teams to define product requirements, features, and functionalities based on customer needs and market trends.
● Drive efficient and effective product development processes while maintaining high-quality standards.
Technical Leadership:
● Provide technical leadership, guidance, and mentorship to the engineering and R&D teams, fostering a culture of innovation, collaboration, and continuous learning.
● Oversee the design, architecture, and development of hardware and software components for AR/VR devices.
● Ensure compliance with industry standards and best practices in product design and development.
Research and Development:
● Lead research initiatives to explore emerging technologies, materials, and design concepts that can be incorporated into future product iterations.
● Foster a culture of experimentation and prototyping to drive technical advancements and breakthroughs.
Collaboration and Communication:
● Collaborate closely with product management, design, marketing, and sales teams to ensure seamless alignment of technology efforts with business objectives.
● Communicate complex technical concepts to non-technical stakeholders and foster a shared understanding of the company's technology vision.
Qualifications:
● Bachelor's or Master's degree in Engineering, Computer Science, or related field. A PhD is a plus.
● Proven experience of 5+ years in a senior leadership role overseeing technology and product development in the AR/VR, consumer electronics, or related industries.
● Strong background in hardware and software engineering with expertise in AR/VR technologies, optics, sensors, displays, and related fields.
● Demonstrated success in bringing innovative products to market, from concept to commercialization.
● Experience in managing and leading cross-functional teams, fostering a culture of collaboration and innovation.
● Excellent strategic thinking, problem-solving, and decision-making skills.
● Outstanding communication and interpersonal skills to effectively engage with internal teams, partners, and stakeholders.
● Entrepreneurial mindset with the ability to adapt to a dynamic and fast-paced environment.
● Knowledge of industry regulations, standards, and compliance requirements.
Join us at PVK Tech Solutions and be at the forefront of shaping the future of AR/VR technology. If you're a visionary leader with a passion for innovation, we'd love to hear
• Project Planning and Management
o Take end-to-end ownership of multiple projects / project tracks
o Create and maintain project plans and other related documentation for project
objectives, scope, schedule and delivery milestones
o Lead and participate across all the phases of software engineering, right from
requirements gathering to GO LIVE
o Lead internal team meetings on solution architecture, effort estimation, manpower
planning and resource (software/hardware/licensing) planning
o Manage RIDA (Risks, Impediments, Dependencies, Assumptions) for projects by
developing effective mitigation plans
• Team Management
o Act as the Scrum Master
o Conduct SCRUM ceremonies like Sprint Planning, Daily Standup, Sprint Retrospective
o Set clear objectives for the project and roles/responsibilities for each team member
o Train and mentor the team on their job responsibilities and SCRUM principles
o Make the team accountable for their tasks and help the team in achieving them
o Identify the requirements and come up with a plan for Skill Development for all team
members
• Communication
o Be the Single Point of Contact for the client in terms of day-to-day communication
o Periodically communicate project status to all the stakeholders (internal/external)
• Process Management and Improvement
o Create and document processes across all disciplines of software engineering
o Identify gaps and continuously improve processes within the team
o Encourage team members to contribute towards process improvement
o Develop a culture of quality and efficiency within the team
Must have:
• Minimum 08 years of experience (hands-on as well as leadership) in software / data engineering
across multiple job functions like Business Analysis, Development, Solutioning, QA, DevOps and
Project Management
• Hands-on as well as leadership experience in Big Data Engineering projects
• Experience developing or managing cloud solutions using Azure or other cloud provider
• Demonstrable knowledge on Hadoop, Hive, Spark, NoSQL DBs, SQL, Data Warehousing, ETL/ELT,
DevOps tools
• Strong project management and communication skills
• Strong analytical and problem-solving skills
• Strong systems level critical thinking skills
• Strong collaboration and influencing skills
Good to have:
• Knowledge on PySpark, Azure Data Factory, Azure Data Lake Storage, Synapse Dedicated SQL
Pool, Databricks, PowerBI, Machine Learning, Cloud Infrastructure
• Background in BFSI with focus on core banking
• Willingness to travel
Work Environment
• Customer Office (Mumbai) / Remote Work
Education
• UG: B. Tech - Computers / B. E. – Computers / BCA / B.Sc. Computer Science
Job Description
Do you have a passion for computer vision and deep learning problems? We are looking for someone who thrives on collaboration and wants to push the boundaries of what is possible today! Material Depot (materialdepot.in) is on a mission to be India’s largest tech company in the Architecture, Engineering and Construction space by democratizing the construction ecosystem and bringing stakeholders onto a common digital platform. Our engineering team is responsible for developing Computer Vision and Machine Learning tools to enable digitization across the construction ecosystem. The founding team includes people from top management consulting firms and top colleges in India (like BCG, IITB), and have worked extensively in the construction space globally and is funded by top Indian VCs.
Our team empowers Architectural and Design Businesses to effectively manage their day to day operations. We are seeking an experienced, talented Data Scientist to join our team. You’ll be bringing your talents and expertise to continue building and evolving our highly available and distributed platform.
Our solutions need complex problem solving in computer vision that require robust, efficient, well tested, and clean solutions. The ideal candidate will possess the self-motivation, curiosity, and initiative to achieve those goals. Analogously, the candidate is a lifelong learner who passionately seeks to improve themselves and the quality of their work. You will work together with similar minds in a unique team where your skills and expertise can be used to influence future user experiences that will be used by millions.
In this role, you will:
- Extensive knowledge in machine learning and deep learning techniques
- Solid background in image processing/computer vision
- Experience in building datasets for computer vision tasks
- Experience working with and creating data structures / architectures
- Proficiency in at least one major machine learning framework
- Experience visualizing data to stakeholders
- Ability to analyze and debug complex algorithms
- Good understanding and applied experience in classic 2D image processing and segmentation
- Robust semantic object detection under different lighting conditions
- Segmentation of non-rigid contours in challenging/low contrast scenarios
- Sub-pixel accurate refinement of contours and features
- Experience in image quality assessment
- Experience with in depth failure analysis of algorithms
- Highly skilled in at least one scripting language such as Python or Matlab and solid experience in C++
- Creativity and curiosity for solving highly complex problems
- Excellent communication and collaboration skills
- Mentor and support other technical team members in the organization
- Create, improve, and refine workflows and processes for delivering quality software on time and with carefully calculated debt
- Work closely with product managers, customer support representatives, and account executives to help the business move fast and efficiently through relentless automation.
How you will do this:
- You’re part of an agile, multidisciplinary team.
- You bring your own unique skill set to the table and collaborate with others to accomplish your team’s goals.
- You prioritize your work with the team and its product owner, weighing both the business and technical value of each task.
- You experiment, test, try, fail, and learn continuously.
- You don’t do things just because they were always done that way, you bring your experience and expertise with you and help the team make the best decisions.
For this role, you must have:
- Strong knowledge of and experience with the functional programming paradigm.
- Experience conducting code reviews, providing feedback to other engineers.
- Great communication skills and a proven ability to work as part of a tight-knit team.
- Experience with relational SQL & NoSQL databases including MySQL & MongoDB.
- Familiar with the basic principles of distributed computing and data modeling.
- Experience with distributed data pipeline frameworks like Celery, Apache Airflow, etc.
- Experience with NLP and NER models is a bonus.
- Experience building reusable code and libraries for future use.
- Experience building REST APIs.
Preference for candidates working in tech product companies
- Customize, develop and support solutions on salesforce.com platform.
- Develop, test, document and deploy high quality solutions for our clients.
- Working closely with clients and the development team to determine the project requirements.
- Document unit test scripts and record test results post completion of development.
- Review self and peer's code/configuration as part of review process.
Hard Skills
- Strong understanding of the SDLC
- (Agile and Waterfall approaches and tools)
- Advanced Salesforce customization/coding (Apex & Visualforce development)
- Salesforce data loading & using data loader/Data stage/related tools.
- Lightning component experience preferred.
- Knowledge in Java/.Net Programming & OOPs concepts is an added advantage.
- Basic source control knowledge Git/SVN
- Proficient in building integrated solution involving web services using both REST and SOAP
- Strong in RDBMS concepts, SQL and SOQL query languages and ER concepts
- Experience of developing using Eclipse/Mavens Mate IDE
- Hands on experience in migrating code/configuration to production is an added advantage.
Good to have
- Certifications on Salesforce Admin, App Builder, Platform Developer 1 is a must
- Comfortable & familiar with MS office tools
- Analytical & problem-solving skills
- Clear communication and articulation ability
- Team player
Soft Skills
- Effective written and oral communication
- Inspire and motivate the team to perform at their best.
- Professional maturity to give and receive feedback.
- Supports team members in meeting their commitments.
- Good presentation skills to run governance and steering committee meetings.
- Excellent listening skills with sharp acumen to replay or summarize conversations especially when a client is involved.
- Ability to cross/up sell when there is an opportunity.
- Understand client business and add value to requirement conversation.
Role and Responsibilities
- Build a low latency serving layer that powers DataWeave's Dashboards, Reports, and Analytics functionality
- Build robust RESTful APIs that serve data and insights to DataWeave and other products
- Design user interaction workflows on our products and integrating them with data APIs
- Help stabilize and scale our existing systems. Help design the next generation systems.
- Scale our back end data and analytics pipeline to handle increasingly large amounts of data.
- Work closely with the Head of Products and UX designers to understand the product vision and design philosophy
- Lead/be a part of all major tech decisions. Bring in best practices. Mentor younger team members and interns.
- Constantly think scale, think automation. Measure everything. Optimize proactively.
- Be a tech thought leader. Add passion and vibrance to the team. Push the envelope.
Skills and Requirements
- 8- 15 years of experience building and scaling APIs and web applications.
- Experience building and managing large scale data/analytics systems.
- Have a strong grasp of CS fundamentals and excellent problem solving abilities. Have a good understanding of software design principles and architectural best practices.
- Be passionate about writing code and have experience coding in multiple languages, including at least one scripting language, preferably Python.
- Be able to argue convincingly why feature X of language Y rocks/sucks, or why a certain design decision is right/wrong, and so on.
- Be a self-starter—someone who thrives in fast paced environments with minimal ‘management’.
- Have experience working with multiple storage and indexing technologies such as MySQL, Redis, MongoDB, Cassandra, Elastic.
- Good knowledge (including internals) of messaging systems such as Kafka and RabbitMQ.
- Use the command line like a pro. Be proficient in Git and other essential software development tools.
- Working knowledge of large-scale computational models such as MapReduce and Spark is a bonus.
- Exposure to one or more centralized logging, monitoring, and instrumentation tools, such as Kibana, Graylog, StatsD, Datadog etc.
- Working knowledge of building websites and apps. Good understanding of integration complexities and dependencies.
- Working knowledge linux server administration as well as the AWS ecosystem is desirable.
- It's a huge bonus if you have some personal projects (including open source contributions) that you work on during your spare time. Show off some of your projects you have hosted on GitHub.