Multi-Parameter Website Scraping With Power Query

Callum Green shows how to build up a URL based off of multiple parameters, scraping data from a page for each permutation of parameters:

The sections highlighted in red are the parameters and sit in between some of the hard-coded URL text

Code Breakdown:

–          Text = http://www.boxofficemojo.com/monthly/?page=

–          Parameter = [Page]

–          Text = &view=calendargross&yr=

–          Parameter = [Year]

–          Text = &month=

–          Parameter = [Month]

–          Text = &p=.htm

This is a rather clever solution, and if your parameters are functionally dependent (unlike this example, where it was a simple cross join of the three domains), you can still use the solution the same way; you just need to populate your parameter combination table differently.

Related Posts

Jitter In Power BI Charts

Rob Collie shows how to incorporate jitter in Power BI scatter charts: Now, sometimes you may WANT multiple rows to combine into one dot, but in this particular case, I want to see each row of my source data as its own dot. When adding a new calculated column, there are LOTS of ways to uniquely […]

Read More

Power BI Image Timeline

Devin Knight continues his Power BI custom visuals series: In this module you will learn how to use the Image Timeline Custom Visual.  The Image Timeline is a great way to display data in order across a timeline.  If you have images of your data you can also display those images on the timeline. This […]

Read More

Categories

October 2017
MTWTFSS
« Sep Nov »
 1
2345678
9101112131415
16171819202122
23242526272829
3031