<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title></title>
	<atom:link href="https://businessoverbroadway.com/feed/" rel="self" type="application/rss+xml" />
	<link>https://businessoverbroadway.com</link>
	<description>Data Science &#124; Customer Analytics &#124; Machine Learning</description>
	<lastBuildDate>Sun, 02 May 2021 21:49:56 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=6.9.4</generator>
	<item>
		<title>Data Professionals Prefer A Hybrid Approach to Tools and Technologies</title>
		<link>https://businessoverbroadway.com/2021/05/05/data-professionals-prefer-a-hybrid-approach-to-tools-and-technologies/</link>
		
		<dc:creator><![CDATA[Bob Hayes]]></dc:creator>
		<pubDate>Wed, 05 May 2021 09:00:00 +0000</pubDate>
				<category><![CDATA[Data Science]]></category>
		<category><![CDATA[Machine Learning]]></category>
		<guid isPermaLink="false">http://businessoverbroadway.com/?p=9852</guid>

					<description><![CDATA[I recently reached out to data professionals on LinkedIn to ask a series of questions about their work. Results from one of those polls revealed that 58% of data pros reported that they prefer a hybrid approach (on premises and cloud) for their tools and technologies. About a third of respondents preferred the cloud. Only [&#8230;]]]></description>
										<content:encoded><![CDATA[<p style="float: right; margin: 0 0 10px 15px; width:240px; height: auto;">
		<img src="https://businessoverbroadway.com/wp-content/uploads/2021/05/DatProPoll_Tool_Location_square.png" width="240" style="max-width: 100%; height: auto;" />
		</p>
<p>I recently reached out to data professionals on LinkedIn to ask a series of questions about their work. Results from one of those polls revealed that 58% of data pros reported that they prefer a hybrid approach (on premises and cloud) for their tools and technologies. About a third of respondents preferred the cloud. Only 6% of respondents preferred on premises. See figure below.</p>



<figure class="wp-block-image size-large"><a href="http://businessoverbroadway.com/wp-content/uploads/2021/05/DatProPoll_Tool_Location.png"><img decoding="async" width="1024" height="587" src="http://businessoverbroadway.com/wp-content/uploads/2021/05/DatProPoll_Tool_Location-1024x587.png" alt="" class="wp-image-9853" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/05/DatProPoll_Tool_Location-1024x587.png 1024w, https://businessoverbroadway.com/wp-content/uploads/2021/05/DatProPoll_Tool_Location-300x172.png 300w, https://businessoverbroadway.com/wp-content/uploads/2021/05/DatProPoll_Tool_Location-768x441.png 768w, https://businessoverbroadway.com/wp-content/uploads/2021/05/DatProPoll_Tool_Location.png 1060w" sizes="(max-width: 1024px) 100vw, 1024px" /></a><figcaption>LinkedIn poll was conducted the second week of April, 2021. You can view the poll here: <a rel="noreferrer noopener" href="https://www.linkedin.com/feed/update/urn:li:activity:6785234864498110464/" target="_blank">https://www.linkedin.com/feed/update/urn:li:activity:6785234864498110464/</a></figcaption></figure>



<p>What are the differences between data pros who prefer hybrid vs those who prefer cloud? I am attempting to answer that question in study I am currently conducting. Currently, I am conducting a <strong>large-scale survey of data professionals by asking them a set of questions about their work in data science and machine learning.</strong> If you are a data pro, please consider answering this survey. In addition to the poll question above, the survey will cover such topics as <strong>skill sets</strong>, <strong>solutions</strong> used, company’s <strong>ethics</strong> <strong>practices</strong> and <strong>roadblocks to insights</strong>, and more.</p>



<figure class="wp-block-image size-large"><a href="http://bit.ly/dsmlsurvey" target="_blank" rel="noopener"><img loading="lazy" decoding="async" width="836" height="367" src="http://businessoverbroadway.com/wp-content/uploads/2021/03/ODSC_Header_DSMLSurvey.png" alt="" class="wp-image-9786" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/03/ODSC_Header_DSMLSurvey.png 836w, https://businessoverbroadway.com/wp-content/uploads/2021/03/ODSC_Header_DSMLSurvey-300x132.png 300w, https://businessoverbroadway.com/wp-content/uploads/2021/03/ODSC_Header_DSMLSurvey-768x337.png 768w" sizes="auto, (max-width: 836px) 100vw, 836px" /></a><figcaption>Take the Data Science and Machine Learning Survey: <a href="http://bit.ly/dsmlsurvey">http://bit.ly/dsmlsurvey</a></figcaption></figure>



<p>To take the survey, please click the link below.</p>



<p><a rel="noreferrer noopener" href="http://bit.ly/dsmlsurvey" target="_blank">http://bit.ly/dsmlsurvey</a></p>



<p>The survey will take you about 10-15 minutes to complete. Your responses will remain strictly anonymous. However, if you wish to <strong>receive a free executive report</strong> of the findings, you will be asked to provide your name and email address at the end of the survey so that we can email you the report when completed (in a few weeks after the survey closes). In this case, if you do provide your email address, your responses will remain confidential.</p>



<p>Thanks in advance for your help!</p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>How Did the COVID-19 Pandemic Impact Collaboration among Data Scientists?</title>
		<link>https://businessoverbroadway.com/2021/05/03/how-did-the-covid-19-pandemic-impact-collaboration-among-data-scientists/</link>
		
		<dc:creator><![CDATA[Bob Hayes]]></dc:creator>
		<pubDate>Mon, 03 May 2021 09:00:00 +0000</pubDate>
				<category><![CDATA[Data Science]]></category>
		<category><![CDATA[Machine Learning]]></category>
		<category><![CDATA[analytics]]></category>
		<guid isPermaLink="false">http://businessoverbroadway.com/?p=9848</guid>

					<description><![CDATA[I recently reached out to data professionals on LinkedIn to ask a series of questions about their work. Results from one of those polls revealed that 46% of data pros reported that they work more collaboratively with their colleagues now than before the COVID-19 pandemic. About a third of respondents indicated that they work less [&#8230;]]]></description>
										<content:encoded><![CDATA[<p style="float: right; margin: 0 0 10px 15px; width:240px; height: auto;">
		<img src="https://businessoverbroadway.com/wp-content/uploads/2021/04/collaboration_square.png" width="240" style="max-width: 100%; height: auto;" />
		</p>
<p>I recently reached out to data professionals on LinkedIn to ask a series of questions about their work. Results from one of those polls revealed that 46% of data pros reported that they work <em><strong>more collaboratively</strong></em> with their colleagues now than before the COVID-19 pandemic. About a third of respondents indicated that they work less collaboratively with their colleagues now than before the pandemic. Twenty-four percent of respondents report having the same level of collaboration with their colleagues now as before. See figure below.</p>



<figure class="wp-block-image size-large"><a href="http://businessoverbroadway.com/wp-content/uploads/2021/04/Screen-Shot-2021-04-30-at-3.07.07-PM.png"><img loading="lazy" decoding="async" width="1022" height="522" src="http://businessoverbroadway.com/wp-content/uploads/2021/04/Screen-Shot-2021-04-30-at-3.07.07-PM.png" alt="" class="wp-image-9849" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/04/Screen-Shot-2021-04-30-at-3.07.07-PM.png 1022w, https://businessoverbroadway.com/wp-content/uploads/2021/04/Screen-Shot-2021-04-30-at-3.07.07-PM-300x153.png 300w, https://businessoverbroadway.com/wp-content/uploads/2021/04/Screen-Shot-2021-04-30-at-3.07.07-PM-768x392.png 768w" sizes="auto, (max-width: 1022px) 100vw, 1022px" /></a><figcaption>LinkedIn poll was conducted the second week of April, 2021. You can view the poll here: <a rel="noreferrer noopener" href="https://www.linkedin.com/feed/update/urn:li:activity:6787394177933066240/" target="_blank">https://www.linkedin.com/feed/update/urn:li:activity:6787394177933066240/</a></figcaption></figure>



<p>I found the results unexpected as the world went on lockdown at the start of the pandemic, preventing employees from working face-to-face with their colleagues. What are the differences between those data pros who work more collaboratively now and those who work less collaboratively now? I am attempting to answer that question in study I am currently conducting. Specifically, I am conducting a <strong>large-scale survey of data professionals by asking them a set of questions about their work in data science and machine learning.</strong></p>



<p>If you are a data pro, please consider answering this survey. In addition to the poll question above, the survey will cover such topics as <strong>skill sets</strong>, <strong>solutions</strong> used, company’s <strong>ethics</strong> <strong>practices</strong> and <strong>roadblocks to insights</strong>, and more.</p>



<figure class="wp-block-image size-large"><a href="http://bit.ly/dsmlsurvey" target="_blank" rel="noopener"><img loading="lazy" decoding="async" width="836" height="367" src="http://businessoverbroadway.com/wp-content/uploads/2021/03/ODSC_Header_DSMLSurvey.png" alt="" class="wp-image-9786" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/03/ODSC_Header_DSMLSurvey.png 836w, https://businessoverbroadway.com/wp-content/uploads/2021/03/ODSC_Header_DSMLSurvey-300x132.png 300w, https://businessoverbroadway.com/wp-content/uploads/2021/03/ODSC_Header_DSMLSurvey-768x337.png 768w" sizes="auto, (max-width: 836px) 100vw, 836px" /></a><figcaption>Take the Data Science and Machine Learning Survey: <a href="http://bit.ly/dsmlsurvey">http://bit.ly/dsmlsurvey</a></figcaption></figure>



<p>To take the survey, please click the link below.</p>



<p><a rel="noreferrer noopener" href="http://bit.ly/dsmlsurvey" target="_blank">http://bit.ly/dsmlsurvey</a></p>



<p>The survey will take you about 10-15 minutes to complete. Your responses will remain strictly anonymous. However, if you wish to <strong>receive a free executive report</strong> of the findings, you will be asked to provide your name and email address at the end of the survey so that we can email you the report when completed (in a few weeks after the survey closes). In this case, if you do provide your email address, your responses will remain confidential.</p>



<p>Thanks in advance for your help!</p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>Data Professionals are Dissatisfied with their Company&#8217;s Use of Analytics</title>
		<link>https://businessoverbroadway.com/2021/04/29/data-professionals-are-dissatisfied-with-their-companys-use-of-analytics/</link>
		
		<dc:creator><![CDATA[Bob Hayes]]></dc:creator>
		<pubDate>Thu, 29 Apr 2021 18:29:09 +0000</pubDate>
				<category><![CDATA[Data Science]]></category>
		<category><![CDATA[Machine Learning]]></category>
		<category><![CDATA[analytics]]></category>
		<guid isPermaLink="false">http://businessoverbroadway.com/?p=9836</guid>

					<description><![CDATA[a recent LinkedIn poll revealed that data professionals are generally dissatisfied with their company&#8217;s use of analytics in helping it gain a competitive advantage.]]></description>
										<content:encoded><![CDATA[<p style="float: right; margin: 0 0 10px 15px; width:240px; height: auto;">
		<img src="https://businessoverbroadway.com/wp-content/uploads/2021/03/DSMLSurvey_Blog_Image.png" width="240" style="max-width: 100%; height: auto;" />
		</p>
<p>I recently reached out to data professionals on LinkedIn to ask a series of questions about their work. Results from one of those polls revealed that data professionals are generally dissatisfied with their company&#8217;s use of analytics in helping it gain a competitive advantage; nearly 6 in 10 data professionals said they were dissatisfied with their company&#8217;s use of analytics (22% extremely dissatisfied). See figure below.</p>



<figure class="wp-block-image size-large"><a href="http://businessoverbroadway.com/wp-content/uploads/2021/04/Screen-Shot-2021-04-29-at-10.44.22-AM-1.png"><img loading="lazy" decoding="async" width="1024" height="591" src="http://businessoverbroadway.com/wp-content/uploads/2021/04/Screen-Shot-2021-04-29-at-10.44.22-AM-1-1024x591.png" alt="" class="wp-image-9841" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/04/Screen-Shot-2021-04-29-at-10.44.22-AM-1-1024x591.png 1024w, https://businessoverbroadway.com/wp-content/uploads/2021/04/Screen-Shot-2021-04-29-at-10.44.22-AM-1-300x173.png 300w, https://businessoverbroadway.com/wp-content/uploads/2021/04/Screen-Shot-2021-04-29-at-10.44.22-AM-1-768x443.png 768w, https://businessoverbroadway.com/wp-content/uploads/2021/04/Screen-Shot-2021-04-29-at-10.44.22-AM-1.png 1060w" sizes="auto, (max-width: 1024px) 100vw, 1024px" /></a><figcaption>LinkedIn poll was conducted the first week of April, 2021. You can view the poll here: https://www.linkedin.com/feed/update/urn:li:activity:6784911058596372480/ </figcaption></figure>



<p>While this stand-alone poll is somewhat interesting, the true value polling comes when you can ask multiple questions of respondents to see how responses across questions are correlated with each other. For this particular question, correlating responses to other aspects about the respondents&#8217; work environment would help us identify the circumstances when data pros are satisfied vs when they are dissatisfied, essentially helping us identify best practices to optimize satisfaction with company&#8217;s use of analytics. </p>



<p>To identify best practices in analytics, I am conducting a <strong>large-scale survey of data professionals by asking them a set of questions about their work in data science and machine learning.</strong> As a practicing data professional, you are in a unique position to help the world better understand the data science and machine learning landscape. I developed a survey to give you an opportunity to share your work experiences in data and analytics. The survey will cover such topics as <strong>skill sets</strong>, <strong>solutions</strong> used, company’s <strong>ethics</strong> <strong>practices</strong> and <strong>roadblocks to insights</strong>, and more.</p>



<figure class="wp-block-image size-large"><a href="http://bit.ly/dsmlsurvey" target="_blank" rel="noopener"><img loading="lazy" decoding="async" width="836" height="367" src="http://businessoverbroadway.com/wp-content/uploads/2021/03/ODSC_Header_DSMLSurvey.png" alt="" class="wp-image-9786" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/03/ODSC_Header_DSMLSurvey.png 836w, https://businessoverbroadway.com/wp-content/uploads/2021/03/ODSC_Header_DSMLSurvey-300x132.png 300w, https://businessoverbroadway.com/wp-content/uploads/2021/03/ODSC_Header_DSMLSurvey-768x337.png 768w" sizes="auto, (max-width: 836px) 100vw, 836px" /></a><figcaption>Take the Data Science and Machine Learning Survey: <a href="http://bit.ly/dsmlsurvey">http://bit.ly/dsmlsurvey</a></figcaption></figure>



<p>To take the survey, please click the link below.</p>



<p><a rel="noreferrer noopener" href="http://bit.ly/dsmlsurvey" target="_blank">http://bit.ly/dsmlsurvey</a></p>



<p>The survey will take you about 10-15 minutes to complete. Your responses will remain strictly anonymous. However, if you wish to <strong>receive a free executive report</strong> of the findings, you will be asked to provide your name and email address at the end of the survey so that we can email you the report when completed (in a few weeks after the survey closes). In this case, if you do provide your email address, your responses will remain confidential.</p>



<p>Thanks in advance for your help!</p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>Help us Learn More about Data Science and Machine Learning</title>
		<link>https://businessoverbroadway.com/2021/04/22/help-us-learn-more-about-data-science-and-machine-learning/</link>
		
		<dc:creator><![CDATA[Bob Hayes]]></dc:creator>
		<pubDate>Thu, 22 Apr 2021 23:44:32 +0000</pubDate>
				<category><![CDATA[Customer Experience Management]]></category>
		<guid isPermaLink="false">http://businessoverbroadway.com/?p=9827</guid>

					<description><![CDATA[Data professionals, in all their different forms, play a significant role in how businesses operate today. From business analysts and data scientists to machine learning engineers and software developers, these data professionals extract insights from data and use those insights to drive businesses forward. Finding and using these data-driven insights requires the interplay of data [&#8230;]]]></description>
										<content:encoded><![CDATA[<p style="float: right; margin: 0 0 10px 15px; width:240px; height: auto;">
		<img src="http://businessoverbroadway.com/wp-content/uploads/2021/03/DSMLSurvey_600.png" width="240" style="max-width: 100%; height: auto;" />
		</p>
<p>Data professionals, in all their different forms, play a significant role in how businesses operate today. From business analysts and data scientists to machine learning engineers and software developers, these data professionals extract insights from data and use those insights to drive businesses forward. Finding and using these data-driven insights requires the interplay of data pros, processes and technologies.</p>



<p>While we do know a lot about optimize the value of your data analytics efforts requires that we understand howFinding insights in data and using those insights to drive businesses forward involves the interplay of people, processes and technologies.  </p>



<script type="text/javascript" src="https://ssl.gstatic.com/trends_nrtr/2431_RC04/embed_loader.js"></script> <script type="text/javascript"> trends.embed.renderExploreWidget("TIMESERIES", {"comparisonItem":[{"keyword":"/m/0jt3_q3","geo":"US","time":"2004-03-03 2021-03-31"},{"keyword":"/m/01hyh_","geo":"US","time":"2004-03-03 2021-03-31"},{"keyword":"big data","geo":"US","time":"2004-03-03 2021-03-31"},{"keyword":"artificial intelligence","geo":"US","time":"2004-03-03 2021-03-31"}],"category":0,"property":""}, {"exploreQuery":"date=2004-03-03%202021-03-31&geo=US&q=%2Fm%2F0jt3_q3,%2Fm%2F01hyh_,big%20data,artificial%20intelligence","guestPath":"https://trends.google.com:443/trends/embed/"}); </script>



<p>Calling all data professionals. An excellent way to learn about a subject is to ask people involved in that subject. Specifically, to learn about data science and machine learning, it is good to ask data professionals who work in those areas. A few years ago, I conducted a study  by asking data professionals about their data science experience; I basically applied data science to the field of data science. Not surprisingly, that study generated a lot of insights about data science and the data professionals in that field, helping to establish the state of the industry as well as identifying best practices (see: <a rel="noreferrer noopener" href="http://businessoverbroadway.com/2015/12/14/getting-more-insights-from-data-nine-facts-about-the-practice-of-data-science/" target="_blank">Getting More Insights from Data: Nine Facts about the Practice of Data Science</a>).</p>



<figure class="wp-block-image size-large"><a href="http://bit.ly/dsmlsurvey"><img loading="lazy" decoding="async" width="600" height="194" src="http://businessoverbroadway.com/wp-content/uploads/2021/03/DSMLSurvey_600.png" alt="" class="wp-image-9780" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/03/DSMLSurvey_600.png 600w, https://businessoverbroadway.com/wp-content/uploads/2021/03/DSMLSurvey_600-300x97.png 300w" sizes="auto, (max-width: 600px) 100vw, 600px" /></a><figcaption>To take the survey, click the link: <a rel="noreferrer noopener" href="http://bit.ly/dsmlsurvey" target="_blank">http://bit.ly/dsmlsurvey</a></figcaption></figure>



<p>Today, I am extending that research and am reaching out to the data community to ask for help. As a practicing data professional, you are in a unique position to help the world better understand the data science and machine learning landscape. I developed a survey to give you an opportunity to share your work experiences in data and analytics. The survey will cover such topics as <strong>skill sets</strong>, <strong>solutions</strong> used, company’s <strong>ethics</strong> <strong>practices</strong> and <strong>roadblocks to insights</strong>, and more.</p>



<p>To take the survey, please click the link below.</p>



<p><a rel="noreferrer noopener" href="http://bit.ly/dsmlsurvey" target="_blank">http://bit.ly/dsmlsurvey</a></p>



<h3 class="wp-block-heading">Help Us Answer<strong> </strong>Two Questions</h3>



<p>Your feedback will help us answer two broad questions:</p>



<ol class="wp-block-list" type="1"><li><strong>What is the state of data science and machine learning?</strong> What DS and ML practices, tools and technologies are companies currently adopting? Which industries are excelling?</li><li><strong>What are the best practices in DS and ML?</strong> What specific DS and ML practices will help give companies a competitive advantage? How should companies design an analytics center of excellence that is world class?</li></ol>



<p>The survey will take you about 10-15 minutes to complete. Your responses will remain strictly anonymous. However, if you wish to <strong><u>receive a free executive report</u></strong> of the findings, you will be asked to provide your name and email address at the end of the survey so that we can email you the report when completed (in a few weeks after the survey closes). In this case, if you do provide your email address, your responses will remain confidential.</p>



<p>The survey will be open through the end of April. To take the survey, please click the button below:</p>



<div class="wp-block-image is-style-rounded"><figure class="aligncenter size-large"><a href="http://bit.ly/dsmlsurvey"><img loading="lazy" decoding="async" width="257" height="40" src="http://businessoverbroadway.com/wp-content/uploads/2021/03/TakeSurveyButton.png" alt="" class="wp-image-9781"/></a></figure></div>



<p>If you have any questions about the survey, please <a href="http://businessoverbroadway.com/contact/" data-type="page" data-id="38">contact</a> me.</p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>Take the Data Science and Machine Learning Survey</title>
		<link>https://businessoverbroadway.com/2021/03/22/take-the-data-science-and-machine-learning-survey/</link>
		
		<dc:creator><![CDATA[Bob Hayes]]></dc:creator>
		<pubDate>Mon, 22 Mar 2021 08:00:00 +0000</pubDate>
				<category><![CDATA[Analytics]]></category>
		<category><![CDATA[Data Science]]></category>
		<category><![CDATA[Machine Learning]]></category>
		<guid isPermaLink="false">http://businessoverbroadway.com/?p=9782</guid>

					<description><![CDATA[Data Science Roles and Their Skill Sets An excellent way to learn about a subject is to ask people involved in that subject. Specifically, to learn about data science and machine learning, it is good to ask data professionals who work in those areas. A few years ago, I conducted a study by asking data [&#8230;]]]></description>
										<content:encoded><![CDATA[<p style="float: right; margin: 0 0 10px 15px; width:240px; height: auto;">
		<img src="https://businessoverbroadway.com/wp-content/uploads/2021/03/DSMLSurvey_Blog_Image.png" width="240" style="max-width: 100%; height: auto;" />
		</p>
<div class="wp-block-image"><figure class="alignright size-large is-resized"><img loading="lazy" decoding="async" src="http://businessoverbroadway.com/wp-content/uploads/2017/10/ProficiencybyDataScienceRole-1024x576.png" alt="" class="wp-image-8666" width="483" height="272" srcset="https://businessoverbroadway.com/wp-content/uploads/2017/10/ProficiencybyDataScienceRole-1024x576.png 1024w, https://businessoverbroadway.com/wp-content/uploads/2017/10/ProficiencybyDataScienceRole-300x169.png 300w, https://businessoverbroadway.com/wp-content/uploads/2017/10/ProficiencybyDataScienceRole-768x432.png 768w, https://businessoverbroadway.com/wp-content/uploads/2017/10/ProficiencybyDataScienceRole.png 1366w" sizes="auto, (max-width: 483px) 100vw, 483px" /><figcaption>Data Science Roles and Their Skill Sets</figcaption></figure></div>



<p>An excellent way to learn about a subject is to ask people involved in that subject. Specifically, to learn about data science and machine learning, it is good to ask data professionals who work in those areas. A few years ago, I conducted a study  by asking data professionals about their data science experience; I basically applied data science to the field of data science. Not surprisingly, that study generated a lot of insights about data science and the data professionals in that field, helping to establish the state of the industry as well as identifying best practices (see: <a rel="noreferrer noopener" href="http://businessoverbroadway.com/2015/12/14/getting-more-insights-from-data-nine-facts-about-the-practice-of-data-science/" target="_blank">Getting More Insights from Data: Nine Facts about the Practice of Data Science</a>).</p>



<figure class="wp-block-image size-large"><a href="http://bit.ly/dsmlsurvey"><img loading="lazy" decoding="async" width="600" height="194" src="http://businessoverbroadway.com/wp-content/uploads/2021/03/DSMLSurvey_600.png" alt="" class="wp-image-9780" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/03/DSMLSurvey_600.png 600w, https://businessoverbroadway.com/wp-content/uploads/2021/03/DSMLSurvey_600-300x97.png 300w" sizes="auto, (max-width: 600px) 100vw, 600px" /></a><figcaption>To take the survey, click the link: <a rel="noreferrer noopener" href="http://bit.ly/dsmlsurvey" target="_blank">http://bit.ly/dsmlsurvey</a></figcaption></figure>



<p>Today, I am extending that research and am reaching out to the data community to ask for help. As a practicing data professional, you are in a unique position to help the world better understand the data science and machine learning landscape. I developed a survey to give you an opportunity to share your work experiences in data and analytics. The survey will cover such topics as <strong>skill sets</strong>, <strong>solutions</strong> used, company’s <strong>ethics</strong> <strong>practices</strong> and <strong>roadblocks to insights</strong>, and more.</p>



<p>To take the survey, please click the link below.</p>



<p><a rel="noreferrer noopener" href="http://bit.ly/dsmlsurvey" target="_blank">http://bit.ly/dsmlsurvey</a></p>



<h3 class="wp-block-heading">Help Us Answer<strong> </strong>Two Questions</h3>



<p>Your feedback will help us answer two broad questions:</p>



<ol class="wp-block-list" type="1"><li><strong>What is the state of data science and machine learning?</strong> What DS and ML practices, tools and technologies are companies currently adopting? Which industries are excelling?</li><li><strong>What are the best practices in DS and ML?</strong> What specific DS and ML practices will help give companies a competitive advantage? How should companies design an analytics center of excellence that is world class?</li></ol>



<p>The survey will take you about 10-15 minutes to complete. Your responses will remain strictly anonymous. However, if you wish to <strong><u>receive a free executive report</u></strong> of the findings, you will be asked to provide your name and email address at the end of the survey so that we can email you the report when completed (in a few weeks after the survey closes). In this case, if you do provide your email address, your responses will remain confidential.</p>



<p>The survey will be open through April 22. To take the survey, please click the button below:</p>



<div class="wp-block-image is-style-rounded"><figure class="aligncenter size-large"><a href="http://bit.ly/dsmlsurvey"><img loading="lazy" decoding="async" width="257" height="40" src="http://businessoverbroadway.com/wp-content/uploads/2021/03/TakeSurveyButton.png" alt="" class="wp-image-9781"/></a></figure></div>



<p>If you have any questions about the survey, please <a href="http://businessoverbroadway.com/contact/" data-type="page" data-id="38">contact</a> me.</p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>Gender Inequality Persists in Data Science and AI</title>
		<link>https://businessoverbroadway.com/2021/03/08/gender-inequality-persists-in-data-science-and-ai/</link>
		
		<dc:creator><![CDATA[Bob Hayes]]></dc:creator>
		<pubDate>Mon, 08 Mar 2021 09:00:00 +0000</pubDate>
				<category><![CDATA[Data Science]]></category>
		<category><![CDATA[analytics]]></category>
		<category><![CDATA[Data science]]></category>
		<category><![CDATA[Kaggle]]></category>
		<category><![CDATA[machine learning]]></category>
		<guid isPermaLink="false">http://businessoverbroadway.com/?p=9738</guid>

					<description><![CDATA[Results of a survey of data professionals show that about 1 out of 5 are women. Women are paid less than their male counterparts yet both women and men have similar levels of education.]]></description>
										<content:encoded><![CDATA[<p style="float: right; margin: 0 0 10px 15px; width:240px; height: auto;">
		<img src="https://businessoverbroadway.com/wp-content/uploads/2021/03/Kaggle_2020_Gender_Breakdown_by_Job_Title.png" width="240" style="max-width: 100%; height: auto;" />
		</p>
<p><em>Results of a survey of data professionals show that about 1 out of 5 are women. Women are paid less than their male counterparts yet both women and men have similar levels of education. Ways of improving gender diversity in the field of data science are offered.</em></p>



<div class="wp-block-image"><figure class="alignright size-large"><a href="http://businessoverbroadway.com/wp-content/uploads/2021/03/USLaborForceStatistics.png"><img loading="lazy" decoding="async" width="502" height="434" src="http://businessoverbroadway.com/wp-content/uploads/2021/03/USLaborForceStatistics.png" alt="" class="wp-image-9742" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/03/USLaborForceStatistics.png 502w, https://businessoverbroadway.com/wp-content/uploads/2021/03/USLaborForceStatistics-300x259.png 300w" sizes="auto, (max-width: 502px) 100vw, 502px" /></a><figcaption>Figure 1. US Labor Force Statistics for Selected Occupations</figcaption></figure></div>



<p>Even though women make up about half of the total workforce in the US, those numbers hide the disparities in some occupational domains.  As you can see in Figure 1, while women make up about half of the life, physical and social science occupations in the US, they only account for 25% and 17% of the professionals in computer and mathematical occupations and architecture and engineering occupations, respectively.</p>



<p>Look at diversity numbers for some tech giants, and you will see that women make up a small part of the technology industry. In 2020, women made up 30% of the employees at <a rel="noreferrer noopener" href="https://query.prod.cms.rt.microsoft.com/cms/api/am/binary/RE4H2f8#page=5" target="_blank">Microsoft</a>, 32% at <a rel="noreferrer noopener" href="https://www.statista.com/statistics/311800/google-employee-gender-global/" target="_blank">Google</a>, 45% at <a rel="noreferrer noopener" href="https://www.aboutamazon.com/news/workplace/our-workforce-data#:~:text=Among%20Amazon's%20global%20employees%2C%2044.6,and%2070.7%25%20identify%20as%20men." target="_blank">Amazon</a> and 37% at <a rel="noreferrer noopener" href="https://www.statista.com/statistics/311827/facebook-employee-gender-global/" target="_blank">Facebook</a>. In fact, these numbers have only slightly improved, if at all, over the past 6 years. </p>



<div class="wp-block-image"><figure class="alignright size-large"><a href="http://businessoverbroadway.com/wp-content/uploads/2021/03/Kaggle_2020_Gender_Breakdown_by_Job_Title.png"><img loading="lazy" decoding="async" width="1002" height="557" src="http://businessoverbroadway.com/wp-content/uploads/2021/03/Kaggle_2020_Gender_Breakdown_by_Job_Title.png" alt="" class="wp-image-9747" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/03/Kaggle_2020_Gender_Breakdown_by_Job_Title.png 1002w, https://businessoverbroadway.com/wp-content/uploads/2021/03/Kaggle_2020_Gender_Breakdown_by_Job_Title-300x167.png 300w, https://businessoverbroadway.com/wp-content/uploads/2021/03/Kaggle_2020_Gender_Breakdown_by_Job_Title-768x427.png 768w" sizes="auto, (max-width: 1002px) 100vw, 1002px" /></a><figcaption>Figure 2. Gender differences across Job Titles. Click image to enlarge.</figcaption></figure></div>



<p>How does gender diversity look in the data science world? Using data from LinkedIn, the&nbsp;<a rel="noreferrer noopener" href="http://www3.weforum.org/docs/WEF_GGGR_2020.pdf" target="_blank">World Economic Forum’s 2020</a>&nbsp;Global Gender Gap Report shows women make up only 26% of professionals in Data and AI.</p>



<p>I analyzed data from the <a rel="noreferrer noopener" href="https://www.kaggle.com/c/kaggle-survey-2020" target="_blank">2020 Kaggle Machine Learning and Data Science survey</a> in which they surveyed over 20,000 data professionals. That survey showed that, overall, 20% of the respondents were women (see Figure 2), a result somewhat comparable with the percent of women in high-tech companies in general. Gender disparity varied over job titles of data professionals. Women represented 24% (a high, mind you) of the data professionals who identified as a Statistician or Data Analyst. Women, on the other hand, represented only around 13% of data professionals who identified as a Product/Project Manager, Machine Learning Engineer, Software Engineer or Data(base) Engineer.</p>



<div class="wp-block-image"><figure class="alignright size-large is-resized"><img loading="lazy" decoding="async" src="http://businessoverbroadway.com/wp-content/uploads/2021/03/Kaggle_2020_Salary_By_Gender_USA_only.png" alt="" class="wp-image-9760" width="464" height="354" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/03/Kaggle_2020_Salary_By_Gender_USA_only.png 678w, https://businessoverbroadway.com/wp-content/uploads/2021/03/Kaggle_2020_Salary_By_Gender_USA_only-300x229.png 300w" sizes="auto, (max-width: 464px) 100vw, 464px" /><figcaption>Figure 3. Annual Salaries of Data Professionals from the US. Median salary for men was $100,000 &#8211; $124,999. Median salary for women was $90,000 &#8211; $99,999.</figcaption></figure></div>



<h4 class="wp-block-heading">Salary Differences</h4>



<p>Using data from 2018 and 2019, the <a href="https://www.census.gov/newsroom/stories/equal-pay-day.html">US Census Bureau estimates</a> that, for every dollar that men earn, women earn 81.6 cents.</p>



<p>We looked at differences between men and women data professionals in the US with respect to their salary. In line with the Census figures, women&#8217;s median salary in the US was $90,000-$99,999 while the men&#8217;s median salary was $100,000-$124,999 (see Figure 3). That comes out to women data professionals earning roughly 84 cents to every dollar that men earn. </p>



<div class="wp-block-image"><figure class="alignright size-large"><a href="http://businessoverbroadway.com/wp-content/uploads/2021/03/Kaggle_2020_Education_Attained_by_Gender-1.png"><img loading="lazy" decoding="async" width="501" height="453" src="http://businessoverbroadway.com/wp-content/uploads/2021/03/Kaggle_2020_Education_Attained_by_Gender-1.png" alt="" class="wp-image-9753" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/03/Kaggle_2020_Education_Attained_by_Gender-1.png 501w, https://businessoverbroadway.com/wp-content/uploads/2021/03/Kaggle_2020_Education_Attained_by_Gender-1-300x271.png 300w" sizes="auto, (max-width: 501px) 100vw, 501px" /></a><figcaption>Figure 3. No gender difference in formal education among data professionals.</figcaption></figure></div>



<h4 class="wp-block-heading">Educational Background</h4>



<p>Women and men in the field of data science do not differ with respect to their formal educational background (see Figure 3). For both genders, a majority of each held advanced degrees (i.e., Master&#8217;s: ~41%; Doctoral: ~12%) and around 35% held a Bachelor&#8217;s degree. Compared to the results of a <a href="http://businessoverbroadway.com/2015/12/07/improving-gender-diversity-in-data-science/">similar analysis in 2015</a>, the percent of data professionals holding Doctoral and Master&#8217;s degrees has declined while the percent of those holding Bachelor&#8217;s degrees has increased. The annual Stanford 2021 AI Index reports that <a href="https://hai.stanford.edu/blog/ai-index-diversity-report-unmoving-needle">women account for less than 19%</a> of all AI and computer science PhD graduates in North America over the past 10 years. </p>



<p>In 2015, around 50% of data pros held a Master&#8217;s degree, 20% held a Doctoral degree and a quarter of them held a Bachelor&#8217;s degree. This shift in the educational makeup of those who are in the data analytics profession could be the result of more people moving into the field of data analytics at a young age. Also, the growth of universities that offer <a href="https://www.discoverdatascience.org/programs/bachelors-in-data-science/">undergraduate degrees in the field of data science</a> has exploded since 2015. </p>



<p>Not only do men and women data professionals possess similar educational degrees, they also possess the same skill set. <a href="http://businessoverbroadway.com/2015/12/07/improving-gender-diversity-in-data-science/" data-type="post" data-id="7750">In a prior study</a>, I found that men and women possessed comparable proficiency in subject matter expertise, technology and programming and math/statistics.</p>



<h3 class="wp-block-heading">Benefits of Gender Diversity</h3>



<p>Gender diversity is good for business. In 2014, <a rel="noreferrer noopener" href="http://www.gallup.com/businessjournal/166220/business-benefits-gender-diversity.aspx" target="_blank">Gallup</a> found that more gender diverse business units outperform their less gender diverse counterparts with respect to revenue and net profits. Also, in 2017, <a rel="noreferrer noopener" href="https://www.mckinsey.com/business-functions/organization/our-insights/delivering-through-diversity#" target="_blank">McKinsey</a> reports that companies in the top quartile for gender diversity are 21% more likely to outperform companies in the bottom quartile.</p>



<p>It has been argued that improving gender diversity would help ameliorate the bias found in our AI algorithms. Because algorithms reflect the values of  data professionals who create them, a diverse workforce would act as a gatekeeper to potential bias.</p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow"><p>More simply put, if an organization’s leadership and workforce do not reflect the diverse range of customers it serves, its outputs will eventually be found to be substandard. Because learning algorithms are a part of larger systems composed of other technologies and the people who create them and implement them, bias can creep in anywhere in the pipeline. If the diversity within an organization’s pipeline is low at any point, the organization opens itself up to biases — including ones that are deep enough and, potentially, public enough that they could divide customers and eventually lead to obsolescence and failure. Some customers would stay, but others would leave.</p><cite>~ Ayanna Howard and Charles Isbell from <a href="https://sloanreview.mit.edu/article/diversity-in-ai-the-invisible-men-and-women/">Diversity in AI: The Invisible Men and Women</a></cite></blockquote>



<h3 class="wp-block-heading">What You Can Do to Improve Representation of Women in Data Science</h3>



<p>Researchers <a rel="noreferrer noopener" href="https://www.linkedin.com/in/fran-berman-5301114" target="_blank">Francine Berman</a> and <a rel="noreferrer noopener" href="https://www.linkedin.com/in/philip-bourne-b98921" target="_blank">Philip Bourne</a> proposed 10 ways you can <a rel="noreferrer noopener" href="http://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.1002206" target="_blank">improve gender diversity in data science</a>. These changes come about through changing of the work culture and advocating for women&#8217;s representation in data science. You can see their specific tips in Figure 4.</p>



<div class="wp-block-image"><figure class="alignright"><a href="http://businessoverbroadway.com/wp-content/uploads/2015/12/datasciencebloggenderdiff10SimpleRules.png"><img loading="lazy" decoding="async" width="683" height="680" src="http://businessoverbroadway.com/wp-content/uploads/2015/12/datasciencebloggenderdiff10SimpleRules.png" alt="Figure 5. Ten Simple Rules for Increasing Gender Diversity in Data Science. Click image to enlarge" class="wp-image-7773" srcset="https://businessoverbroadway.com/wp-content/uploads/2015/12/datasciencebloggenderdiff10SimpleRules.png 683w, https://businessoverbroadway.com/wp-content/uploads/2015/12/datasciencebloggenderdiff10SimpleRules-150x150.png 150w, https://businessoverbroadway.com/wp-content/uploads/2015/12/datasciencebloggenderdiff10SimpleRules-300x300.png 300w" sizes="auto, (max-width: 683px) 100vw, 683px" /></a><figcaption>Figure 4. Ten Simple Rules for Increasing Gender Diversity in Data Science. Click image to enlarge. From article, <a rel="noopener noreferrer" href="http://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.1002206" target="_blank">Let&#8217;s Make Gender Diversity in Data Science a Priority Right from the Start</a>.</figcaption></figure></div>



<h3 class="wp-block-heading">Summary</h3>



<p>The data science, machine learning and AI professions have a long way to go to reach gender equality. The current analysis revealed low rates of women employees in all data-related roles. Gender inequality also revealed itself in salary differences of men and women, with women data professionals making Despite this gender disparity, we did not see any large gender differences with respect to educational background; both women and men achieved similar levels of education. Data professionals can take practical steps to improve the representation of women in data science, including changing the work culture around gender diversity and being an activist for women&#8217;s representation in data science. </p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>Computing Platforms Used Most Often for Data Science Projects</title>
		<link>https://businessoverbroadway.com/2021/03/02/computing-platforms-used-by-data-professionals/</link>
		
		<dc:creator><![CDATA[Bob Hayes]]></dc:creator>
		<pubDate>Tue, 02 Mar 2021 10:00:00 +0000</pubDate>
				<category><![CDATA[Data Science]]></category>
		<category><![CDATA[analytics]]></category>
		<category><![CDATA[Data science]]></category>
		<category><![CDATA[machine learning]]></category>
		<guid isPermaLink="false">http://businessoverbroadway.com/?p=9717</guid>

					<description><![CDATA[Results of a worldwide survey reveal that data professionals overwhelmingly use a personal computer or laptop as their computing platform most often for their data science projects. The next most used computing platform is a cloud computing platform and a deep learning workstation. The practice of data science requires a variety of different tools and [&#8230;]]]></description>
										<content:encoded><![CDATA[<p style="float: right; margin: 0 0 10px 15px; width:240px; height: auto;">
		<img src="https://businessoverbroadway.com/wp-content/uploads/2021/03/kaggle_2020_Comp_Plat_by_Job_Title.jpg" width="240" style="max-width: 100%; height: auto;" />
		</p>
<p><em>Results of a worldwide survey reveal that data professionals overwhelmingly use a personal computer or laptop as their computing platform most often for their data science projects. The next most used computing platform is a cloud computing platform and a deep learning workstation. </em></p>



<p>The practice of data science requires a variety of different tools and technologies to extract value from data. One piece of equipment that is commonly used is the computing platform. A computing platform is the <a href="https://en.wikipedia.org/wiki/Computing_platform">environment</a> in which a piece of software is executed. </p>



<p>In a worldwide machine learning and data science survey by <a rel="noreferrer noopener" href="https://www.kaggle.com/c/kaggle-survey-2020" target="_blank">Kaggle in late 2020</a> of over 20,000 data professionals, respondents were asked a variety of questions regarding the data science tools they typically use. For one of the questions, respondents were asked, &#8220;What type of computing platform do you use most often for your data science projects?&#8221; The results of that question appear in Figure 1. Nearly 80% of the respondents said that they use a person computer or laptop most often for their data science projects. Fourteen percent of data professionals use a cloud computing platform most often. The list of computing platforms and the percent of respondents who use them are:</p>



<div class="wp-block-group"><div class="wp-block-group__inner-container is-layout-flow wp-block-group-is-layout-flow">
<ol class="wp-block-list"><li>A personal computer or laptop (78%)</li><li>A cloud computing platform (AWS, Azure, GCP, hosted notebooks, etc) (14%)</li><li>A deep learning workstation (NVIDIA GTX, LambdaLabs, etc) (5%)</li><li>Other (1%)</li><li>None (2%)</li></ol>



<figure class="wp-block-image size-large"><img loading="lazy" decoding="async" width="1002" height="556" src="http://businessoverbroadway.com/wp-content/uploads/2021/03/kaggle_2020_Comp_Plat_by_Job_Title.jpg" alt="" class="wp-image-9729" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/03/kaggle_2020_Comp_Plat_by_Job_Title.jpg 1002w, https://businessoverbroadway.com/wp-content/uploads/2021/03/kaggle_2020_Comp_Plat_by_Job_Title-300x166.jpg 300w, https://businessoverbroadway.com/wp-content/uploads/2021/03/kaggle_2020_Comp_Plat_by_Job_Title-768x426.jpg 768w" sizes="auto, (max-width: 1002px) 100vw, 1002px" /><figcaption>Figure 1. Computing Platforms Used by Data Professionals</figcaption></figure>
</div></div>



<div class="wp-block-group"><div class="wp-block-group__inner-container is-layout-flow wp-block-group-is-layout-flow">
<p>Figure 1 also includes the results broken down by job title. While the personal computer/laptop remained the most popular computing platform, we see that the results varied significantly by job title; only 2/3rds of Machine Learning Engineers, Data Engineers and Data Scientists use a personal computer/laptop while nearly 90% of Statistician, Business Analysts and Data Analysts use a personal computer/laptop. That difference is primarily driven by the former group (~25%) utilizing a cloud computing platform at a higher rate than the latter group (10%). The biggest users of deep learning workstations are Machine Learning Engineers (13%, Research Scientists (13%) and Data Scientists (7%).</p>



<h3 class="wp-block-heading">Size of Datasets</h3>



<p>In this Big Data, deep learning world in which we live, you might think that data professionals lean heavily on the likes of cloud computing platforms and/or deep learning workstations. KDNuggets conducted a poll to determine the largest datasets analyzed by respondents. Results showed that most of the data professionals work with data in the gigabyte range (see Figure 2). The overall median response was between 11 and 100 GB, the size that can comfortably fit on one laptop. Given data professionals typically deal with relatively small datasets, it&#8217;s not surprising that most data professionals use a personal computer/laptop for their data science projects.</p>
</div></div>



<figure class="wp-block-image size-large"><img loading="lazy" decoding="async" width="643" height="387" src="http://businessoverbroadway.com/wp-content/uploads/2021/03/poll-largest-dataset-analyzed-2020-3yrs-643-1.jpg" alt="" class="wp-image-9721" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/03/poll-largest-dataset-analyzed-2020-3yrs-643-1.jpg 643w, https://businessoverbroadway.com/wp-content/uploads/2021/03/poll-largest-dataset-analyzed-2020-3yrs-643-1-300x181.jpg 300w" sizes="auto, (max-width: 643px) 100vw, 643px" /><figcaption>Figure 2. KDNuggets poll on largest dataset analyzed (2020).</figcaption></figure>



<h3 class="wp-block-heading">Summary</h3>



<p>The top computing platform used most often by data professionals is a personal computer or laptop, followed by a cloud computing platform and a deep learning workstation. </p>



<p>Use of computing platforms varied over job titles, with Machine Learning Engineers, Data Scientists and Data Engineers use cloud computing platforms more often than other data professionals. </p>



<p> </p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>Top Job Activities for Different Data Professionals</title>
		<link>https://businessoverbroadway.com/2021/02/21/typical-job-activities-for-different-data-professionals/</link>
		
		<dc:creator><![CDATA[Bob Hayes]]></dc:creator>
		<pubDate>Sun, 21 Feb 2021 22:00:31 +0000</pubDate>
				<category><![CDATA[Data Science]]></category>
		<category><![CDATA[Machine Learning]]></category>
		<category><![CDATA[Data science]]></category>
		<category><![CDATA[machine learning]]></category>
		<guid isPermaLink="false">http://businessoverbroadway.com/?p=9691</guid>

					<description><![CDATA[Results of a survey of data professionals show that different data roles engage in different activities while at work. Data Scientists indicated that three activities make up an important part of their work, the most across all data roles. The top activities across all data roles were related to analyzing data to influence decisions and [&#8230;]]]></description>
										<content:encoded><![CDATA[<p style="float: right; margin: 0 0 10px 15px; width:240px; height: auto;">
		<img src="https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_Work_Activities_by_JobTitle.png" width="240" style="max-width: 100%; height: auto;" />
		</p><p><em>Results of a survey of data professionals show that different data roles engage in different activities while at work. Data Scientists indicated that three activities make up an important part of their work, the most across all data roles. The top activities across all data roles were related to analyzing data to influence decisions and building prototypes.</em></p>
<p>The practice of data science is about extracting value from data to help inform decision making and improve algorithms. As such, data science requires <a href="http://businessoverbroadway.com/2015/09/23/investigating-data-scientists-their-skills-and-team-makeup/">three broad skill sets</a>, including subject matter expertise, statistics/math and technology/programming. Because different data professionals possess diverse and complementary skill sets, the practice of data science requires a collaborative effort across different data professionals. But what exactly do different data professionals do at work? What broad activities make up their respective jobs?</p>
<p>Kaggle conducted a worldwide survey of over 20000 data professionals to learn about the state of data science and machine learning. The survey included the question, &#8220;Select any activities that make up an important part of your role at work: (Select all that apply).&#8221; They were given a list of six general activities from which to select.</p>
<p><div id="attachment_9706" style="width: 533px" class="wp-caption alignright"><a href="http://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_Work_Activities.jpg"><img loading="lazy" decoding="async" aria-describedby="caption-attachment-9706" class=" wp-image-9706" src="http://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_Work_Activities.jpg" alt="" width="523" height="268" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_Work_Activities.jpg 1034w, https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_Work_Activities-300x153.jpg 300w, https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_Work_Activities-1024x524.jpg 1024w, https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_Work_Activities-768x393.jpg 768w" sizes="auto, (max-width: 523px) 100vw, 523px" /></a><p id="caption-attachment-9706" class="wp-caption-text">Figure 1. Work activities of data professionals.</p></div></p>
<p>Results showed that, on average, data professionals selected one activity. The percent of respondents that selected each activities is (see Figure 1):</p>
<ol>
<li>Analyze and understand data to influence product or business decisions (52%)</li>
<li>Build prototypes to explore applying machine learning to new areas (32%)</li>
<li>Build and/or run the data infrastructure that my business uses for storing, analyzing, and operationalizing data (27%)</li>
<li>Experimentation and iteration to improve existing ML models (25%)</li>
<li>Build and/or run a machine learning service that operationally improves my product or workflows (22%)</li>
<li>Do research that advances the state of the art of machine learning (19%)</li>
<li>None of these activities are an important part of my role at work (14%)</li>
<li>Other (4%)</li>
</ol>
<h3>Differences across Job Titles</h3>
<p>The number of activities that make up an important part of data professionals&#8217; roles at work varied over job titles. Some job roles include a broader set of work activities compared to other job roles that included a more narrow set of activities. Specifically, most data professionals reported that only one activity that was an important part of their work; they included Business Analyst, DBA/Database Engineer, Data Analyst, Product/Project Manager, Software Engineer and Statistician.</p>
<p>Data professionals who reported two activities included Machine Learning Engineer, Data Engineer and Research Scientist. Data Scientists reported the highest number of work activities with three.</p>
<p>We selected a few job titles to illustrate the different activity profiles of data professionals (see Figure 2). Generally, we see that some job roles are broad with respect to their work activities (e.g., Data Scientist, Machine Learning Engineer) while others are narrow (e.g., Product/Project Manager, Business Analyst, DBA/Database Engineer).</p>
<p><div id="attachment_9685" style="width: 527px" class="wp-caption alignright"><a href="http://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_Work_Activities_by_JobTitle.png"><img loading="lazy" decoding="async" aria-describedby="caption-attachment-9685" class=" wp-image-9685" src="http://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_Work_Activities_by_JobTitle-1024x899.png" alt="" width="517" height="454" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_Work_Activities_by_JobTitle-1024x899.png 1024w, https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_Work_Activities_by_JobTitle-300x263.png 300w, https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_Work_Activities_by_JobTitle-768x674.png 768w, https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_Work_Activities_by_JobTitle.png 1066w" sizes="auto, (max-width: 517px) 100vw, 517px" /></a><p id="caption-attachment-9685" class="wp-caption-text">Figure 2. Percent of data professionals say activity is an important part of their role at work. Click image to enlarge. </p></div></p>
<p>While the top work activity was &#8220;Analyze and understand data&#8221; for most of the job titles (i.e., Business Analyst, Data Analyst, Data Engineer, Data Scientist, Product/Project Manager, Software Engineer and  Statistician), the top activities for other job titles were:</p>
<ol>
<li>Research Scientist: Do research that advances the state of the art of ML</li>
<li>DBA/Database Engineer: Build and/or run the data infrastructure</li>
<li>Machine Learning Engineer: Build prototypes to explore applying ML</li>
</ol>
<h3>Summary</h3>
<p>Data professionals are involved in different work activities. While many data pros are focused primarily on analyzing and understanding data (the top activity among data professionals), a few of them see their primary work around data infrastructure, building prototypes or conducting research to advance knowledge.</p>
<p>Respondents who self-identified as Data Scientists, on average, indicated that they are involved in the most number of activities at work (3), followed by Machine Learning Engineers, Data Engineers and Research Scientists who reported being involved in 2. The remaining data professionals are generally involved in one activity (Business Analyst, DBA/Database Engineer, Data Analyst, Product/Project Manager, Software Engineer and  Statistician.</p>
<p>Not all data professionals are created equal. Results showed that the work activity profiles varied greatly across different data roles. While many of the respondents indicated that analysis and understanding of data to influence products/decisions was the top activity for them, a top activity for Research Scientists was doing research that advances the state of the art of machine learning. Additionally, the top activity for DBA/Database Engineers was building and/or running the data infrastructure. The activity profiles for each data professional (see Figure 2) gives us a sense that some jobs involve several important activities while others involve fewer (a single?) important activities.</p>
<p>The top work activity for data professional roles appears to be very practical and necessary to run day-to-day business operations. These top work activities included influencing business decisions, building prototypes to expand machine learning to new areas and improving ML models. The bottom activity was more about long-term understanding of machine learning reflected in conducting research to advance the state of the art of machine learning.</p>
<p>Different data roles possess different activity profiles. Top work activities tend to be associated with the skill sets of different data roles. Building/Running data infrastructure was the top activity for Data Engineers; doing research to advance the field of machine learning was a top activity for Research Scientists. These results are not surprising as we know that <a href="http://businessoverbroadway.com/2015/09/23/investigating-data-scientists-their-skills-and-team-makeup/">different data professionals have different skill sets</a>. In prior research, I found that data professionals who self-identified as Researchers have a strong math/statistics/research skill set. Developers, on the other hand, have strong programming/technology skills. And data professionals who were Domain Experts have strong business-domain knowledge.</p>
<p>Remember that data professionals have their unique skill set that makes them a better fit for some data roles than others. When applying for data-related positions, it might be useful to look at the type of work activities for which you have experience (or are competent) and apply for the positions with corresponding job titles. For example, if you are proficient in running a data infrastructure, you might consider focusing on Data Engineer jobs. If you have a strong skill set related to research and statistics, you might be more likely to get a call back when applying for Research Scientist positions.</p>
<p>Data science and machine learning work really <a href="http://businessoverbroadway.com/2015/09/23/investigating-data-scientists-their-skills-and-team-makeup/">is a team sport</a>. Getting data teams with members who have complementary skill sets who are capable of performing their specific job activities will likely improve the success rate of data science and machine learning projects.</p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>Machine Learning Algorithms and the Data Pros Who Use Them</title>
		<link>https://businessoverbroadway.com/2021/02/14/machine-learning-algorithms-and-the-data-pros-who-use-them/</link>
		
		<dc:creator><![CDATA[Bob Hayes]]></dc:creator>
		<pubDate>Sun, 14 Feb 2021 22:00:34 +0000</pubDate>
				<category><![CDATA[Data Science]]></category>
		<category><![CDATA[Machine Learning]]></category>
		<category><![CDATA[Data science]]></category>
		<category><![CDATA[Kaggle]]></category>
		<category><![CDATA[statistics]]></category>
		<guid isPermaLink="false">http://businessoverbroadway.com/?p=9675</guid>

					<description><![CDATA[A recent survey by Kaggle revealed that data professionals used a variety of different ML algorithms in their work.]]></description>
										<content:encoded><![CDATA[<p style="float: right; margin: 0 0 10px 15px; width:240px; height: auto;">
		<img src="https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_ML_Algorithms_Used.png" width="240" style="max-width: 100%; height: auto;" />
		</p><p><em>A recent survey by Kaggle revealed that data professionals used a variety of different ML algorithms in their work. On average, data professionals used two (median) algorithms. The most frequently used algorithms were 1) linear/logistic regression, 2) decision trees/random forests and 3) Convolutional Neural Networks. The total number of and use of specific algorithms varied across job titles, with ML engineers using the most (4) and DBA/Database Engineers using the least (1). </em></p>
<p>Machine learning algorithms are employed by data professionals to predict important outcomes as well as find patterns and structure in their data. The application of machine learning reaches across industries (e.g., healthcare, education) and professions (e.g., marketing, content management). Kaggle conducted a worldwide survey in October 2020 (<a href="https://www.kaggle.com/c/kaggle-survey-2020">2020 Kaggle Machine Learning and Data Science Survey</a>), asking over 20,000 data professionals about the work they do, including the ML algorithms they tend to use.</p>
<p><div id="attachment_9679" style="width: 461px" class="wp-caption alignright"><a href="http://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_ML_Algorithms_Used.png"><img loading="lazy" decoding="async" aria-describedby="caption-attachment-9679" class=" wp-image-9679" src="http://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_ML_Algorithms_Used.png" alt="" width="451" height="286" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_ML_Algorithms_Used.png 853w, https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_ML_Algorithms_Used-300x190.png 300w, https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_ML_Algorithms_Used-768x487.png 768w" sizes="auto, (max-width: 451px) 100vw, 451px" /></a><p id="caption-attachment-9679" class="wp-caption-text">Figure 1. Top Machine Learning Algorithms Used in 2020. Click image to enlarge.</p></div></p>
<p>The survey included a question for data professionals, “Which of the following machine learning algorithms do you use on a regular basis? Select all that apply.” On average, data professionals reported that they use 2 (median) machine learning algorithms. The top 10 machine learning algorithms used were (see Figure 1):</p>
<ol>
<li>Linear or Logistic Regression (59%)</li>
<li>Decision Trees or Random Forests (49%)</li>
<li>Convolutional Neural Networks (33%)</li>
<li>Gradient Boosting Machines (xgboost, lightgbm, etc) (29%)</li>
<li>Bayesian Approaches (20%)</li>
<li>Recurrent Neural Networks (19%)</li>
<li>Dense Neural Networks (MLPs, etc) (19%)</li>
<li>Transformer Networks (BERT, gpt-3, etc) (7%)</li>
<li>Generative Adversarial Networks (6%)</li>
<li>Evolutionary Approaches (4%)</li>
</ol>
<h3>Data Professionals Use Different Algorithms</h3>
<p><div id="attachment_9683" style="width: 539px" class="wp-caption alignright"><a href="http://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_ML_Algos_by_JobTitle.png"><img loading="lazy" decoding="async" aria-describedby="caption-attachment-9683" class=" wp-image-9683" src="http://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_ML_Algos_by_JobTitle-1024x875.png" alt="" width="529" height="452" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_ML_Algos_by_JobTitle-1024x875.png 1024w, https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_ML_Algos_by_JobTitle-300x256.png 300w, https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_ML_Algos_by_JobTitle-768x656.png 768w, https://businessoverbroadway.com/wp-content/uploads/2021/02/Kaggle_2020_ML_Algos_by_JobTitle.png 1095w" sizes="auto, (max-width: 529px) 100vw, 529px" /></a><p id="caption-attachment-9683" class="wp-caption-text">Figure 2. Machine Learning Algorithm Usage Across Different Job Titles for Data Professionals. Click image to enlarge.</p></div></p>
<p>Not all data professionals are created equal. Comparing data professionals by job title, we found that the data professionals differed with respect to the number of ML algorithms used and the types of ML algorithms used. Specifically, the survey results revealed that data professionals who used greatest number of algorithms were:</p>
<ol>
<li>Machine Learning Engineer (4 algos used)</li>
<li>Data Engineer (3 used)</li>
<li>Data Scientist (3 used)</li>
<li>Research Scientist (3 used)</li>
</ol>
<p>The job title with the lowest number of algorithms used was DBA/Database Engineer (1 used).</p>
<p>Figure 2 includes information about ML algorithm usage for specific job titles. While Linear or Logistic Regression and Decision Trees or Random Forests were clearly the top algorithms across all data professional, for some data pros, many of them use additional algorithms as part of their work; specifically, many Machine Learning Engineers and Research Scientists use Convolutional Neural Networks (62% and 47%, respectively). More than half of Data Scientists (57%) say they use Gradient Boosting Machines. Finally, more than a third of Machine Learning Engineers (39%) say they use Recurrent Neural Networks and Dense Neural Networks (MLPs, etc) on a regular basis.</p>
<p>It&#8217;s not difficult to imagine that the use of ML algorithms is likely related to the type of work activities in which each data professionals are involved. We have seen before that different data roles <a href="http://businessoverbroadway.com/2020/08/04/who-does-the-machine-learning-and-data-science-work/">possess different job activity profiles</a>; work-related activities will necessarily dictate the types of algorithms that are needed to effectively perform each activity. Building and running data infrastructures requires different algorithms than doing research to advance the field of machine learning. Next week, I&#8217;ll look at the these activities across the data roles studies in this blog.</p>
<p>When applying for data-related job, it could be useful to understand the typical types of machine learning algorithms you will need to know to be successful in that position. If you&#8217;re competent in a variety of ML algorithms, you might be able to successfully broaden your job search to include different data roles.</p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>Machine Learning Adoption Rates Around the World</title>
		<link>https://businessoverbroadway.com/2021/02/01/machine-learning-adoption-rates-around-the-world/</link>
		
		<dc:creator><![CDATA[Bob Hayes]]></dc:creator>
		<pubDate>Mon, 01 Feb 2021 10:00:06 +0000</pubDate>
				<category><![CDATA[Analytics]]></category>
		<category><![CDATA[Artificial Intelligence]]></category>
		<category><![CDATA[Machine Learning]]></category>
		<category><![CDATA[Data science]]></category>
		<guid isPermaLink="false">http://businessoverbroadway.com/?p=9659</guid>

					<description><![CDATA[A worldwide survey of data professionals showed that adoption of machine learning methods in their company is 45%. Twenty-one percent of survey respondents said their employer is exploring ML methods. ML adoption rates varied by country with Israel (63%), Netherlands (57%) and the United States (56%) showing the highest and Egypt (31%), Morocco (24%) and [&#8230;]]]></description>
										<content:encoded><![CDATA[<p style="float: right; margin: 0 0 10px 15px; width:240px; height: auto;">
		<img src="https://businessoverbroadway.com/wp-content/uploads/2021/01/Kaggle_2020_ML_Adoption_by_country.png" width="240" style="max-width: 100%; height: auto;" />
		</p><p><em>A worldwide survey of data professionals showed that adoption of machine learning methods in their company is 45%. Twenty-one percent of survey respondents said their employer is exploring ML methods. ML adoption rates varied by country with Israel (63%), Netherlands (57%) and the United States (56%) showing the highest and Egypt (31%), Morocco (24%) and Nigeria (23%) showing the lowest adoption rate. ML adoption also varied by company size, with larger companies having higher adoption rates (61%) than medium (45%) and small (33%) companies.</em></p>
<p>Businesses are leveraging the <a href="https://research.aimultiple.com/ml-stats/">power of machine learning methods</a> to help them extract better quality information, increase productivity, reduce costs and extract more value from their data. As the amount of data continues to grow along with the processing power of technology, businesses will continue to incorporate ML into their business. Researchers have found different AI / ML adoption rates. In one study, <a href="https://www.itprotoday.com/artificial-intelligence/census-data-finds-low-ai-adoption-rate-enterprise">adoption rate</a> of ML Methods was 10%; in a 2020 study by <a href="https://www.mckinsey.com/business-functions/mckinsey-analytics/our-insights/global-survey-the-state-of-ai-in-2020">McKinsey</a>, adoption rate of AI was 50%. Still, <a href="https://www.forbes.com/sites/louiscolumbus/2020/01/19/roundup-of-machine-learning-forecasts-and-market-estimates-2020/?sh=1e40e3295c02">another study</a> found that 42% of companies were currently using AI and 40% of companies were planning on using AI in the next two years. Another <a href="https://www.spglobal.com/marketintelligence/en/news-insights/latest-news-headlines/ai-use-adoption-gains-momentum-with-enterprise-amid-pandemic-8211-451-survey-62163095">2020 study</a> found that 59% of enterprises have machine learning initiatives either in production or at a proof-of-concept stage.</p>
<h3>Current Analysis on Machine Learning Adoption</h3>
<p>Kaggle conducted a worldwide survey in October 2020 of 20,036 data professionals (<a href="https://www.kaggle.com/c/kaggle-survey-2020">2020 Kaggle Machine Learning and Data Science Survey</a>). The survey sample consisted of data professionals, including men (~79%) and women (~19%), from a variety of job titles (e.g., data scientist, business analyst, machine learning engineer, software developer) and company sizes. The survey asked a variety of questions, including &#8220;Does your current employer incorporate machine learning methods into their business?&#8221;</p>
<p><div id="attachment_9664" style="width: 581px" class="wp-caption alignright"><a href="http://businessoverbroadway.com/wp-content/uploads/2021/01/Kaggle_2020_ML_Adoption_by_country.png"><img loading="lazy" decoding="async" aria-describedby="caption-attachment-9664" class=" wp-image-9664" src="http://businessoverbroadway.com/wp-content/uploads/2021/01/Kaggle_2020_ML_Adoption_by_country-850x1024.png" alt="" width="571" height="688" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/01/Kaggle_2020_ML_Adoption_by_country-850x1024.png 850w, https://businessoverbroadway.com/wp-content/uploads/2021/01/Kaggle_2020_ML_Adoption_by_country-249x300.png 249w, https://businessoverbroadway.com/wp-content/uploads/2021/01/Kaggle_2020_ML_Adoption_by_country-768x926.png 768w, https://businessoverbroadway.com/wp-content/uploads/2021/01/Kaggle_2020_ML_Adoption_by_country.png 989w" sizes="auto, (max-width: 571px) 100vw, 571px" /></a><p id="caption-attachment-9664" class="wp-caption-text">Figure 1. Machine Learning Adoption Rates across Countries. Click image to enlarge.</p></div></p>
<h4>Machine Learning Adoption by Country</h4>
<p>Results of the survey appear in Figure 1 for the overall sample as well as countries that have 50 or more respondents. Overall, results show that the adoption rate of machine learning methods is 45%. Twenty-one percent of respondents indicate their company is exploring ML methods. Twenty percent of respondents indicate their company does not use ML methods.</p>
<p>Countries that are early adopters of ML methods include:</p>
<ol>
<li>Israel (63% adopt ML)</li>
<li>Netherlands (57%)</li>
<li>United States (56%)</li>
<li>UK and Northern Ireland (54%)</li>
<li>Germany (54%)</li>
<li>Australia (53%)</li>
<li>France (52%)</li>
<li>China (52%)</li>
<li>Taiwan (51%)</li>
<li>Greece (49%)</li>
</ol>
<p>Countries with the lowest adoption rate of ML methods include:</p>
<ol>
<li>Nigeria (23% adopt ML)</li>
<li>Morocco (24%)</li>
<li>Egypt (31%)</li>
<li>Philippines (31%)</li>
<li>Argentina (32%)</li>
</ol>
<p>Countries with the highest percent of companies exploring ML methods include:</p>
<ol>
<li>Chile (36% are exploring ML methods)</li>
<li>Sweden (35%)</li>
<li>Malaysia (32%)</li>
<li>South Korea (31%)</li>
<li>Peru (29%)</li>
</ol>
<p><div id="attachment_9667" style="width: 461px" class="wp-caption alignright"><a href="http://businessoverbroadway.com/wp-content/uploads/2021/01/Kaggle_2020_ML_Adoption_by_company_size.png"><img loading="lazy" decoding="async" aria-describedby="caption-attachment-9667" class=" wp-image-9667" src="http://businessoverbroadway.com/wp-content/uploads/2021/01/Kaggle_2020_ML_Adoption_by_company_size.png" alt="" width="451" height="283" srcset="https://businessoverbroadway.com/wp-content/uploads/2021/01/Kaggle_2020_ML_Adoption_by_company_size.png 872w, https://businessoverbroadway.com/wp-content/uploads/2021/01/Kaggle_2020_ML_Adoption_by_company_size-300x188.png 300w, https://businessoverbroadway.com/wp-content/uploads/2021/01/Kaggle_2020_ML_Adoption_by_company_size-768x482.png 768w" sizes="auto, (max-width: 451px) 100vw, 451px" /></a><p id="caption-attachment-9667" class="wp-caption-text">Figure 2. Adoption of ML Methods Across Company Size</p></div></p>
<h4>Machine Learning Adoption by Company Size</h4>
<p>We also looked at adoption rates by company size. Those results appear in Figure 2. Supporting prior studies, we found that larger companies have higher adoption rates about ML methods. The largest enterprise companies (10,000+ employees) reported ML adoption rates of 61%. The smallest companies (0-49 employees) reported adoption rates of 33%. Of the smallest companies, a little over a quarter of them (27%) indicate that they are exploring the use of ML methods.</p>
<h3>Summary</h3>
<p>Survey of data professionals showed that adoption rates of machine learning methods among businesses is 45%. About 21% of respondents indicated that their company is exploring machine learning methods with the hope of putting a model into production one day.</p>
<p>ML adoption rate varies by country and company size. Survey results reveal that early adopters come from large enterprise companies (adoption rate of 61%) and some countries including the United States, Israel, Netherlands and the UK and Northern Ireland.</p>
<p>Machine learning vendors, looking for inroads into businesses, could focus their marketing and sales efforts on small businesses as they have the highest percentage of companies who are exploring the use of ML methods.</p>
<p>&nbsp;</p>
]]></content:encoded>
					
		
		
			</item>
	</channel>
</rss>
