We are actively seeking a self-motivated Data Engineer with expertise in Azure cloud and Databricks, with a thorough understanding of Delta Lake and Lake-house Architecture. The ideal candidate should excel in developing scalable data solutions, crafting platform tools, and integrating systems, while demonstrating proficiency in cloud-native database solutions and distributed data processing.
Key Responsibilities:
- Contribute to the development and upkeep of a scalable data platform, incorporating tools and frameworks that leverage Azure and Databricks capabilities.
- Exhibit proficiency in various RDBMS databases such as MySQL and SQL-Server, emphasizing their integration in applications and pipeline development.
- Design and maintain high-caliber code, including data pipelines and applications, utilizing Python, Scala, and PHP.
- Implement effective data processing solutions via Apache Spark, optimizing Spark applications for large-scale data handling.
- Optimize data storage using formats like Parquet and Delta Lake to ensure efficient data accessibility and reliable performance.
- Demonstrate understanding of Hive Metastore, Unity Catalog Metastore, and the operational dynamics of external tables.
- Collaborate with diverse teams to convert business requirements into precise technical specifications.
Requirements:
- Bachelor’s degree in Computer Science, Engineering, or a related discipline.
- Demonstrated hands-on experience with Azure cloud services and Databricks.
- Proficient programming skills in Python, Scala, and PHP.
- In-depth knowledge of SQL, NoSQL databases, and data warehousing principles.
- Familiarity with distributed data processing and external table management.
- Insight into enterprise data solutions for PIM, CDP, MDM, and ERP applications.
- Exceptional problem-solving acumen and meticulous attention to detail.
Additional Qualifications :
- Acquaintance with data security and privacy standards.
- Experience in CI/CD pipelines and version control systems, notably Git.
- Familiarity with Agile methodologies and DevOps practices.
- Competence in technical writing for comprehensive documentation.
Similar jobs
- Develop new features understanding current architecture of system
- Responsible to design , develop, test, integrate and support product life cycle.
- Developing existing systems by analyzing and identifying areas for improvements
- Creating Design/Architecture documents, technical specifications, and test cases in line with Quality systems
- Maintaining systems by identifying and correcting software defectsDeveloping / Influencing Requirements.
- Willing and flexible to work on C++
- Consulting internal / external stakeholders concerning maintenance and performance of software systems; implementing software solutions
- "Strong Object Orientated C++
About the company
It has set up a benchmark in the Medical and Health industry with its Digital revolutionary changes. It had a huge impact on Countries Education & the Health sector, as it has taken an effort to uplift & Developing Digital support in India's Medical Education with the sword of Technologies. Our products are being Designed & Developed to benefit the Medical Aspirant as well as its Country's Health Education system. With its continuous effort, many Medical Institutions have been successfully adopting a Digitalised advanced way of Teaching & Learning. Its MedWhiz LMS is very Effective & Essential for Medical Aspirants.
Experience : 3-4 Years
Responsibilities
● Develop new user-facing features .
● Build reusable code and libraries for future use .
● Ensure the technical feasibility of UI/UX designs .
● Optimize application for maximum speed and scalability.
● Assure that all user input is validated before submitting to the back-end .
● Collaborate with other team members and stakeholders
Skills
● Proficient understanding of web markup, including HTML5, CSS3 .
● Proficient understanding of client-side scripting and JavaScript frameworks.
● Proficient understanding of Bootstrap to make the page responsive.
● Good understanding of advanced JavaScript libraries like React JS and Angular 2+
framework.
● Good understanding of asynchronous request handling, partial page updates, and AJAX .
● Basic knowledge of image authoring tools, to be able to crop, resize, or perform small
adjustments on an image. Familiarity with tools such Photoshop is a plus.
● Proficient understanding of cross-browser compatibility issues and ways to work around
them.
● Proficient understanding of code versioning tools, such as Git.
● Good understanding of SEO principles and ensuring that application will adhere to them.
● Proficient understanding of REST API integration.
Regards
Team Merito
• Responsible for improving test case coverage and reducing customer found issues
• Ability to see inefficiencies in codes and communicate it to the rest of the team
• Ability to take initiatives and come up with plans to help solve these issues
• Involved in documentation such as planning and time estimation for projects
• Presenting ideas for system improvements, including cost proposals
• Producing detailed specifications and writing the program codes
• The key responsibilities of this person will be to unit test the product for functional, look
and feel of the GUI
• To keep in close loop of quality analysts to troubleshoot issues
Desired Candidate Profile:
• Expertise in core development in C#, ASP.net , ADO.net, Dot Net, .Net Core, Rest
API, Web API
• Expertise in HTML, WPF , WCF , LINQ , OOPS, SQL
• Proficient in Visual Studio 13, Visual Studio 15, and Visual Studio 19
(Note: Experience in maintenance phase of the project(s) will not be considered)
• Proficient in Data Structures, Multithreading, Logic Design and implementation with
regards to UI and backend Knowledge on design patterns
• Ability to work in a rapidly changing environment. Proactive behaviour is must have
• Experience in Active Directory, Group Policy, Windows File Server and SQL is an
advantage
• Experience in JIRA/Confluence is an advantage
• Good communication skills
• Experience with SharePoint Online , Exchange Online , Office365, AWS , GSuite ,
Dropbox , Microsoft
• Must be able to work under pressure and towards deadlines
- 3+ years of in design development using Angular, HTML, CSS, Javascript, PHP.
- In-depth knowledge of JavaScript, CSS3, HTML5, Bootstrap, jQuery, REST Services & APIs.
- Experience with test-driven development and testing frameworks/libraries.
- Working knowledge of Git version control systems.
- Must have a notice period of less than 30 days.
- We are looking for a Data Engineer to build the next-generation mobile applications for our world-class fintech product.
- The candidate will be responsible for expanding and optimising our data and data pipeline architecture, as well as optimising data flow and collection for cross-functional teams.
- The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimising data systems and building them from the ground up.
- Looking for a person with a strong ability to analyse and provide valuable insights to the product and business team to solve daily business problems.
- You should be able to work in a high-volume environment, have outstanding planning and organisational skills.
Qualifications for Data Engineer
- Working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimising ‘big data’ data pipelines, architectures, and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- Looking for a candidate with 2-3 years of experience in a Data Engineer role, who is a CS graduate or has an equivalent experience.
What we're looking for?
- Experience with big data tools: Hadoop, Spark, Kafka and other alternate tools.
- Experience with relational SQL and NoSQL databases, including MySql/Postgres and Mongodb.
- Experience with data pipeline and workflow management tools: Luigi, Airflow.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
- Experience with stream-processing systems: Storm, Spark-Streaming.
- Experience with object-oriented/object function scripting languages: Python, Java, Scala.
We are looking for CMS (WordPress and Drupal) Developers for our offshore development center in Indore, India.
Responsibilities:
- 1+ years experience in development, theming.
- Must have knowledge of Customizing WordPress and Drupal Applications
- Develop modify and enhance CMS plugins.
- Develop high-performance, highly scalable, custom development and/or plugin development for WordPress and Drupal sites – integrating templates into CMS.
- Mentor to Junior Developers
- Ability to juggle multiple client projects of varying scope, complexity, and effort.
Requirements:
- Graduate in Computer Science.
- The overall experience of 1+ years in Software Development.
- We are looking for solid CMS (WordPress and Drupal) developer who should have done 3 or more CMS (WordPress and Drupal) projects.
- CMS (WordPress and Drupal) experience is a must.
- 1+ years of experience in development, theming.
- Should be able to write design/requirements documentation.
- Ability to understand technical documents like SRS, Design Document.
- Self-motivated and proactive professional who can take ownership of modules/projects.
- Fluent English communication (verbal & written).
We are looking for a React Native developer interested in building performant mobile apps on both the iOS and Android platforms. You will be responsible for architecting and building these applications, as well as coordinating with the teams responsible for other layers of the product infrastructure. Building a product is a highly collaborative effort, and as such, a strong team player with a commitment to perfection is required.
Responsibilities
- Build pixel-perfect, buttery smooth UIs across both mobile platforms.
- Leverage native APIs for deep integrations with both platforms.
- Diagnose and fix bugs and performance bottlenecks for performance that feels native.
- Reach out to the open source community to encourage and help implement mission-critical software fixesReact Native moves fast and often breaks things.
- Maintain code and write automated tests to ensure the product is of the highest quality.
- Transition existing React web apps to React Native
LearnApp's engineers are a small group of people who directly impact the daily lives of thousands of learners across the globe.
As a software engineer, you are the architect, designer and coder and maintainer of your project.
In addition, you work closely with the product team to make vision become reality.
You are dynamic and able to work well both independently and as part of a team. At LearnApp, we leave all egos at the door and concentrate on the job at hand.
We value passionate, down to earth, “can do” people who enjoy fine-tuning small details, without losing sight of the big picture.
We are looking for the type of person who feels uncomfortable when a day goes by without achieving something impactful.
Someone who is driven to get things done and views obstacles as an exciting challenge that demands a creative solution.
Above all else, this role requires someone who takes great pride in their work and is inspired and motivated by their role in improving the way thousands of learners receive financial literacy. As a Backend Software Engineer, you’ll work closely with our engineers to ensure system consistency and improve user experience. Responsibilities - Analyze functional requirements and creation of software design - Design and implement scalable and robust applications - Design, develop, test, deploy, maintain, and improve software - Design, shape and implement authentication, authorization, auditing, reporting, and API infrastructure solutions Qualifications - Bachelor's degree in Computer Science, a related technical field of study, or equivalent practical experience - Experience in Object-Oriented Design and programming concepts - A minimum of 3 years of working experience in a product oriented company - Programming experience in NodeJS and Typescript or Javascript Preferred Qualifications - Experience in building cloud (SaaS) applications, particularly using AWS technologies - Experience in building serverless applications - Knowledge of Agile software development methodologies - Ability to learn other coding languages as needed - Object-oriented, database design, and SQL skills Perks
- Capability of working remotely from any location
- Deep knowledge in scaling of startups and influence the development of the company
- Transparency with flat hierarchies where every person is highly valued
- Company parties, team lunches, and a lot more events
Requirements:
- Overall experience in the field of Information risk and security related initiatives/ projects.
- Experience in the areas of Infrastructure Security Audit, IT Security, Vulnerability Assessment, Risk Assessment, Web Application Security, Network Security Review, Network Architecture Review, Mobile Application Security Testing, Configuration Review, Source Code Review, Wireless Pentest, Process Review etc.
- Ability to understand business concepts and integrate business risk elements into security operations.
- Experience in conducting VAPT.
- Experience with web application vulnerability scanning tools (e.g., IBM AppScan, HP Web inspect, Acunetix, NTO Spider, BurpSuite Pro).
- Strong ethics and understanding of ethics in business and information security.
- Should have exposure to Code review, Network VA/PT and App VA/PT work.
- Understanding and familiarity with common code review methods and standards.
- Experience with code scanning toolsets such as Fortify and Ounce.
- Understanding of HTTP and web programming.
- Knowledge of OWASP tools and methodologies, common security requirements within ASP.NET application, standard SDLC practices.
- Knowledge of Network Security technology in areas of Firewall, IPS, VPN, Gateway security solutions (proxy, web filtering).
- In-depth understanding on Common Vulnerability Exposure (CVE)/ Cert advisory database.