Search This Blog

Received two questions, 1 through LinkedIn and other through blogger. Sharing details of Q&A here for the benefit of wider audience. Question 1. I want to start with a career in BI, and I am planning to get trained in it. The institute covers MSSQL, Power BI, MSBI, Tableau desktop 10, Informatica developer and admin, Azure data factory, SQL DBA, QLIK sense, Data warehousing. Is this all that is needed? Reply : Regarding getting into BI the best way is to get into a team where you can learn from experienced people in the team. Regarding courses just based on the list that's quite a lot for a training, but it depends on what exactly is provided as part of the training. Need more details about the training. Then once the link was provided, I had a check and provided below reply. Note - Link or institute name is not shared here intentionally to avoid any confusion that I am promoting any institutes. Reply: I have had a look into the link, and from the looks of i

ETL developer vs Data engineer

May 16, 2020

Rephrased question : ETL developer vs Data engineer Answer : Unfortunately there are no strict industry standards on these job titles. That is one part of it. Before ETL tools like Datastage, Informatica, Ab Initio, etc became popular, developers were hand-coding every ETL flow. These ETL tools shortened the ETL flow development time to a great extent and allowed ETL developers to focus on business rule/logic/requirement (what to implement) than how to code it or optimize the code. There are many other benefits of using a tool but I won’t go into that in this answer. So an ETL developer with experience in these tools without any programming (coding) experience was/is able to design and develop end to end data flows. Whenever new types of source/target data format comes up, these tools catch up but it takes time, i.e the ETL tool provider (e.g. Microsoft, IBM, etc) adds new components/ connectors within the ETL tool to be able to work with new data format. For example, let’s say xml f

Corona Virus Analytics

March 19, 2020

This is an interactive dashboard that can be used to find trends, patterns and eventually insights related to COVID-19 (Corona Virus) from a reliable data source. Additional notes provided below the dashboard. Direct link to the Google Data Studio Dashboard is here - https://datastudio.google.com/u/0/reporting/2e4f9914-8905-4cc9-b36a-75dc3f220438/page/7JbY Best viewed on desktop/laptop Notes : This is an interactive dashboard that can be used to find trends, patterns and eventually insights related to COVID-19 (Corona Virus) You can use the filters on the top or click on the charts to filter. Feel free to embed the dashboard in your websites (of course for non commercial use). Currently dashboard doesn’t have real-time information. There is a delay of about 24 hours as the data is mainly sourced from https://github.com/CSSEGISandData/COVID-19/tree/master/csse_covid_19_data ( 2019 Novel Coronavirus COVID-19 (2019-nCoV) Data Repository by Johns Hopkins CSSE). For some o

All views/opinions expressed represent my own and not of my previous or current employers, clients or partners.

Powered by Blogger

Theme images by Dizzo

The views/opinions expressed represent my own and not of my previous or current employers/clients

Best ETL Tool Survey Nov 2016 Results

December 18, 2016

Please find below the results of Best ETL Tool from a developer's perspective survey carried out between 1st Nov 2016 till 16th Dec 2016. Survey link was shared on linkedin and on this site. Thanks to all those DWH/BI developers who took part in this survey. Also thanks to all the members in linkedin groups like Data Warehousing (Business Intelligence, ETL) Professional's Group who provided their inputs via comments. Results from the Survey Results based on comments in Linkedin, As of 18th Dec 2016 is given below Survey Result Analysis 425 responses were collected through the survey between 1st Nov 2016 and 16th Dec 2016. Informatica is the most popular and the best ETL Tool from a developer's perspective based on the Survey results. Out of those respondents who have experience in multiple tools including both Datastage and Informatica, 20% consider Datastage as the best and 46% consider Informatica as the best ETL tool. Out of those r

KABI - The new Agile Methodology for BI Projects - Implement BI projects quicker happily

September 25, 2016

KABI is a new agile software development methodology useful for achieving quicker implementation of Business Intelligence (BI) solutions. The methods defined in KABI can also be used in full or in part for any other non BI projects that share similar characteristics as BI development projects. The word KABI is created by combining "KA" from KA nban and "BI" from B usiness I ntelligence. KABI is a lightweight, iterative, continuous feedback based agile software development methodology that enables every team member to work to their full potential even when there are several unknowns, resource constraints, dependencies and unpredictability of work load. Thereby KABI ensures optimal team productivity throughout the project duration. At the heart of KABI is " Peer Inspiration ". Every team member plays an important role and every team member works in an exemplary way. They do their part of the job so well that it inspires the whole team. " Mutual

IBI New Template - Excel Version

December 26, 2019

Hi Everyone, The latest Excel template for IBI (Individual BI) is published. Again, as usual this is a generic template which you should customize to suit your needs. The generic template is here - https://drive.google.com/open?id=1z2_iEDLkkBqvBHhf-X0qwA0m_niZezAY it has dates up to year 2030. It can be easily extended beyond 2030. To download, once you click on the above link, please click on the top right corner download button. To give you an idea of how to customize and use please see below a customized template that I created for my 11-year old nephew. https://drive.google.com/open?id=1cmTGNU3xlhvKQjna3KR5Vg784OG4ydp7 . And here you can find the customized template that I created for my 6-year old son https://drive.google.com/open?id=1EpxjXFy-k4uD6PxLwvUopQgNc_nPDkbz . All the best for those who are starting their IBI journey from 1st Jan 2020. IBI - Discover yourself factually. Update: How to easily capture the data was already demonstrated in this video p

Corona Virus Analytics

March 19, 2020

This is an interactive dashboard that can be used to find trends, patterns and eventually insights related to COVID-19 (Corona Virus) from a reliable data source. Additional notes provided below the dashboard. Direct link to the Google Data Studio Dashboard is here - https://datastudio.google.com/u/0/reporting/2e4f9914-8905-4cc9-b36a-75dc3f220438/page/7JbY Best viewed on desktop/laptop Notes : This is an interactive dashboard that can be used to find trends, patterns and eventually insights related to COVID-19 (Corona Virus) You can use the filters on the top or click on the charts to filter. Feel free to embed the dashboard in your websites (of course for non commercial use). Currently dashboard doesn’t have real-time information. There is a delay of about 24 hours as the data is mainly sourced from https://github.com/CSSEGISandData/COVID-19/tree/master/csse_covid_19_data ( 2019 Novel Coronavirus COVID-19 (2019-nCoV) Data Repository by Johns Hopkins CSSE). For some o

Discover yourself factually with Individual Business Intelligence (IBI) - BI for Everyone

February 05, 2017

Companies like Facebook, Google and Amazon are trying very very hard to accumulate data about you at every touchpoint, with this accumulated data they want to know more about you, so that, in short, they can sell more to you and the circle you influence. Yes, there is nothing wrong in that, it's their business and they want to improve their business by providing better services and better products. These successful and popular companies and many other companies have realized quite some time back that data is the new gold / new oil / new money i.e Data is an asset. In contrast, have you as an individual ever imagined about you consciously accumulating data about yourself? data related to your physical / mental / emotional statuses, your activities, your life experiences and events in your life? Have you considered your own accumulated data as an asset to you and to your children? Why accumulate data? But why should you consciously accumulate data about yourself and why s