Posts

Showing posts from July, 2018

Data Analysis of Data Scientists Survey Results Report

Image
The Data Analysis of Data Scientists Survey Results Report has been published on Reportpedia.com.  The report is available on this link -  https://www.reportpedia.com/2018/07/data-analysis-of-data-scientists-survey.html . 
Post a Comment
Read more

EU Datathon 2018 Finalist

Image
Feel very happy and motivated that the PublicBI team has been shortlisted as one of the finalist in the EU Datathon 2018 competition organized by the Publications Office of the European Union. For more details about EU Datathon see the official website  https://publications.europa.eu/en/web/eudatathon/speakers .   Congratulations to all the finalists and all the best! This now also means that I have to put some of my planned articles (example GDPR) on hold so that I can work on the Datathon topic.
Post a Comment
Read more

AWS Innovate 2018 - Interesting and Useful

Image
Today I received my certificate for attending the AWS Innovate 2018 Online Conference on 19th July 2018. I had managed to attend all of the sessions from the Big Data and Analytics track and couple of sessions in the AI and Machine Learning track (see agenda below). All of the sessions that I attended were quite interesting and useful. If you have missed don't worry there is still an option to watch the sessions using the on-demand option for free.  See  https://aws.amazon.com/events/aws-innovate/ . If you have attended other tracks and can recommend a must watch session that would be great. I would like to sincerely thank all those who were involved in making this event successful. I can imagine the hard work that would have gone in making this happen based on my experience in organizing the first ever BI Online Conference ( PublicBI BIKON May 2018 ). Looking forward to more such events from AWS team.  AWS Innovate 2018 Agenda Screenshot - Click to enlarge
Post a Comment
Read more

500 Days of IBI

Image
For all those people who are following my blog, especially on the IBI topic, I am happy to announce that I have now completed 500 days of data capture. For all posts related to IBI see  IBI posts . Just by being disciplined enough to capture the data for 500 days and the fact the I managed to do it and still continue doing it, there is some sense of achievement even though nothing is achieved.  So today I spent some time in data analysis, reflected upon the days that went by using data. Went through the details of the mistakes that I have made, the days I was not happy, etc., to understand if there is a recurring pattern and to tell myself that I shouldn't repeat those. I also made some changes to the data capture template and included new charts too.  I have now added a "Year" column in the data capture template because now I have data for more than a year.  With this addition there is possibility to compare same months across years and also to compare year on y
Post a Comment
Read more

Popular posts from this blog

ETL developer vs Data engineer

Image
Rephrased question : ETL developer vs Data engineer Answer : Unfortunately there are no strict industry standards on these job titles. That is just one part of it. Before ETL tools such as DataStage, Informatica, Ab Initio, etc., became popular, developers were hand coding every ETL flow. These ETL tools shortened the ETL flow development time to a great extent and allowed ETL developers to focus on business rule/logic/requirement (what to implement) than how to code it or optimize the code. There are many other benefits of using a tool but I won’t go into that in this answer. So an ETL developer with experience in these tools without any programming (coding) experience was/is able to design and develop end to end data flows. Whenever new types of source/target data format comes up, these tools catch up but it takes time, i.e., the ETL tool provider (e.g. Microsoft, IBM, etc.,) adds new components/connectors within the ETL tool to be able to work with new data format. For example, let’
Read more

KABI - The new Agile Methodology for BI Projects - Implement BI projects quicker happily

Image
KABI is a new agile software development methodology useful for achieving quicker implementation of Business Intelligence (BI) solutions. The methods defined in KABI can also be used in full or in part for any other non BI projects that share similar characteristics as BI development projects.  The word KABI is created by combining "KA" from KA nban and "BI" from B usiness I ntelligence. KABI is a lightweight, iterative, continuous feedback based agile software development methodology that enables every team member to work to their full potential even when there are several unknowns, resource constraints, dependencies and unpredictability of work load. Thereby KABI ensures optimal team productivity throughout the project duration. At the heart of KABI is " Peer Inspiration ".  Every team member plays an important role and every team member works in an exemplary way. They do their part of the job so well that it inspires the whole team. " Mutual
Read more

BI Architect course and BI Tool question

Received two questions, 1 through LinkedIn and other through blogger. Sharing details of Q&A here for the benefit of wider audience. Question 1:  I want to start with a career in BI, and I am planning to get trained in it. The institute covers MSSQL, Power BI, MSBI, Tableau desktop 10, Informatica developer and admin, Azure data factory, SQL DBA, QLIK sense, Data warehousing. Is this all that is needed? Reply : Regarding getting into BI, the best way is to get into a team where you can learn from experienced people in the team. Regarding courses, just based on the list, that's quite a lot for a training, but it depends on what exactly is provided as part of the training. Need more details about the training. Then once the link was provided, I had a check and provided below reply. Note - Link or institute name is not shared here intentionally to avoid any confusion that I am promoting any institutes.  Reply :   I have had a look into the link, as a course for a b
Read more