Posts

Showing posts from January, 2020

How many copies of a payment transaction record?

Image
I am curious to know, approximately how many copies of a payment transaction record are stored across all systems across all parties involved in the payments sector?  Based on a simple and rough calculation I think it is a minimum of 60 copies of each payment transaction. Of course every party doesn't have access to every field (column or data point) and has access only to that part of the record which it is authorized to have access.  So, it looks like we (all parties combined) use at least 60 times more storage than it is required to store a payment transaction record. I'm open to learn from others if I have missed some parties/systems/data layers. And is there a possibility to centralize storage across all parties to store it once and to provide access to parts of the records to parties/systems instead of duplication? May be a point to think. 
Post a Comment
Read more

At least 3 people have started IBI this year

Image
Very happy to know that at least 3 people, whom I know (and have informed me), have started with IBI  (Individual Business Intelligence) from 1st Jan 2020. One is a close friend and ex-Wirecard who has started with 20+ data points, another is a colleague who would like to capture data and do predictive analytics using his data and check if his predictions comes true, and the 3rd one is my 6 year old son with his mama's help who has started capturing various data points including how many times he cried in a day, how many times he fought, how much time he spent learning something, etc. All the best wishes to 3 of them. I am sure more people will realize the benefits of IBI.  To create awareness about IBI I plan to introduce IBI in different languages that I speak. I have started the series with one introductory video in Kannada language. Please find it below, and please share it with friends and family who speak Kannada. Goal is to create as much awareness, including those, who
Post a Comment
Read more

Popular posts from this blog

ETL developer vs Data engineer

Image
Rephrased question : ETL developer vs Data engineer Answer : Unfortunately there are no strict industry standards on these job titles. That is just one part of it. Before ETL tools such as DataStage, Informatica, Ab Initio, etc., became popular, developers were hand coding every ETL flow. These ETL tools shortened the ETL flow development time to a great extent and allowed ETL developers to focus on business rule/logic/requirement (what to implement) than how to code it or optimize the code. There are many other benefits of using a tool but I won’t go into that in this answer. So an ETL developer with experience in these tools without any programming (coding) experience was/is able to design and develop end to end data flows. Whenever new types of source/target data format comes up, these tools catch up but it takes time, i.e., the ETL tool provider (e.g. Microsoft, IBM, etc.,) adds new components/connectors within the ETL tool to be able to work with new data format. For example, let’
Read more

3 years of IBI

This week (on 19th Feb 2020) I completed 3 years of IBI. To celebrate it I have created a Dashboard in Google Data Studio. So from now on instead of using the charts in the Google Sheets I will use the Dashboard. Google Data Studio is more user friendly and mobile friendly too, also it comes with easy to use filters and drill down/up capabilities. PDF version of the first 2 pages of the shareable dashboard is attached below. I am happy to share the first 2 pages of the IBI Dashboard, reach out to me if you would like to get the Google Data Studio IBI dashboard. Once you get the dashboard (without my data of course) you can make a copy of it and point it to your IBI data (assuming you have started), add more charts, pages, etc., and use it for your benefit. Like with every year, this IBI year too I have learnt a lot about myself, made new mistakes, changed several things about me. The benefits of IBI is much more than we can think of. Use it to know it. And what are some of the
Read more