Deprecated: Creation of dynamic property CF\WordPress\DataStore::$logger is deprecated in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-content/plugins/cloudflare/src/WordPress/DataStore.php on line 23
Deprecated: Creation of dynamic property CF\WordPress\Proxy::$pluginAPI is deprecated in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-content/plugins/cloudflare/src/WordPress/Proxy.php on line 31
Deprecated: file_get_contents(): Passing null to parameter #2 ($use_include_path) of type bool is deprecated in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-content/plugins/codelights-shortcodes-and-widgets/codelights.php on line 20
Warning: session_start(): Session cannot be started after headers have already been sent in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-content/plugins/automatic-video-posts/vendor/ternstyle/wordpress/src/class/wordpress.php on line 53
Deprecated: Return type of Requests_Cookie_Jar::offsetExists($key) should either be compatible with ArrayAccess::offsetExists(mixed $offset): bool, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-includes/Requests/Cookie/Jar.php on line 63
Deprecated: Return type of Requests_Cookie_Jar::offsetGet($key) should either be compatible with ArrayAccess::offsetGet(mixed $offset): mixed, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-includes/Requests/Cookie/Jar.php on line 73
Deprecated: Return type of Requests_Cookie_Jar::offsetSet($key, $value) should either be compatible with ArrayAccess::offsetSet(mixed $offset, mixed $value): void, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-includes/Requests/Cookie/Jar.php on line 89
Deprecated: Return type of Requests_Cookie_Jar::offsetUnset($key) should either be compatible with ArrayAccess::offsetUnset(mixed $offset): void, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-includes/Requests/Cookie/Jar.php on line 102
Deprecated: Return type of Requests_Cookie_Jar::getIterator() should either be compatible with IteratorAggregate::getIterator(): Traversable, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-includes/Requests/Cookie/Jar.php on line 111
Deprecated: Return type of Requests_Utility_CaseInsensitiveDictionary::offsetExists($key) should either be compatible with ArrayAccess::offsetExists(mixed $offset): bool, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-includes/Requests/Utility/CaseInsensitiveDictionary.php on line 40
Deprecated: Return type of Requests_Utility_CaseInsensitiveDictionary::offsetGet($key) should either be compatible with ArrayAccess::offsetGet(mixed $offset): mixed, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-includes/Requests/Utility/CaseInsensitiveDictionary.php on line 51
Deprecated: Return type of Requests_Utility_CaseInsensitiveDictionary::offsetSet($key, $value) should either be compatible with ArrayAccess::offsetSet(mixed $offset, mixed $value): void, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-includes/Requests/Utility/CaseInsensitiveDictionary.php on line 68
Deprecated: Return type of Requests_Utility_CaseInsensitiveDictionary::offsetUnset($key) should either be compatible with ArrayAccess::offsetUnset(mixed $offset): void, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-includes/Requests/Utility/CaseInsensitiveDictionary.php on line 82
Deprecated: Return type of Requests_Utility_CaseInsensitiveDictionary::getIterator() should either be compatible with IteratorAggregate::getIterator(): Traversable, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-includes/Requests/Utility/CaseInsensitiveDictionary.php on line 91 Variables – Bonbon's Guide To Data & Tech
Practical Solutions for Excel, Power BI, SQL, Access, Python, Data Science, Automation & Other Tech
Tag: Variables
Deprecated: Creation of dynamic property ternplugin\youtube_video::$post is deprecated in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-content/plugins/automatic-video-posts/vendor/ternstyle/plugin/src/class/youtube_video.php on line 64
Learning how to use variables in DAX formulas is beneficial for data analysts because it allows them to simplify their code and make it easier to read and understand. Variables can be used to store intermediate results, making complex calculations more manageable and reducing the risk of errors. Additionally, using variables can help to optimize query performance, as calculations that are reused multiple times can be cached in memory.
Deprecated: Creation of dynamic property ternplugin\youtube_video::$post is deprecated in /home1/cassanoc/public_html/bonbonsguide.com/wp/wp-content/plugins/automatic-video-posts/vendor/ternstyle/plugin/src/class/youtube_video.php on line 64
I have found several use cases for my team and I to save time and utilize Excel alone for pulling data via SQL, as opposed to running queries in Access, SSRS, SSMS or Toad and then exporting that data into Excel for manipulation and analysis. There is not only the benefit of saving time by skipping the export/import process, but also in the ability to build templates/files and save them for quick and easy future SQL pulls. The days of needing multiple applications for your SQL pulls to import into Excel are over!
The best use cases I’ve found that support this method are repeatable processes where the same input variables are required each time, and where the query results will not exceed the row limitations of an Excel sheet (~1M). Even in this case, you may find the first two sections of this post useful for learning about constructing and executing SQL queries for use outside of Excel. This alone may save you time if you are in the habit of writing long and involved queries with changing criteria.
If you are exceeding the Excel row limit but still want to work in Excel, using Power Pivot can handle this, so you may wish to utilize Power Query instead. See my post on utilizing parameters with Power Query here for more information on how to import the data this way.
I have also found this approach to be useful when pulling data from different sources using the same criteria. It saves me lots of time.
In this example, we will construct and then run a simple SQL query using a few parameters/variables that we enter into the spreadsheet.
Follow along so you can see how it works in practice, and then I encourage you to try it out with your own data. Once you master this method, hopefully you will find amazing ways to apply it to your own work!
A copy of the file described in this post is available for purchase – just reach out to me for information. A more complex version that handles wildcards is also for sale.
Setting Up the Variables/Criteria/Parametersfor Executing SQL Queries in Excel
My goal will be to run this query: Select * from Store where CreatedDate > #3/1/2022# and State = ‘GA’
The two variables in this example will be the created date (3/1/2022) and the State (GA).
At the top of my first sheet, we will designate named ranges for the two inputs.
Simply type in Created Date in cell A1 to identify the input, then in cell B1, type in 3/1/22.
Make B1 a named range – we will call this CreatedDate.
Similarly, in A2, type in State, and then in B2, type in GA. Ultimately, you can add in data validation and use lists, but let’s keep it very simple for now.
Make cell B2 a named range called State.
If you are not familiar with named ranges, the easiest way to make one is to select the cell or cells and then type the name into the dropdown box at the top left next to the formula bar, where the cell address is displayed. Alternately, you can press CTRL+F3 to bring up the Named Ranges dialog box.
Constructing the SQL Statement
From here, we can either construct the SQL statement in an Excel sheet or in VBA. I have found that it is far easier to construct in an Excel sheet, especially for complex statements with many criteria. This way certainly allows for more flexibility and better troubleshooting in my opinion. Also, it’s easier to manage from a support standpoint.
I will add a new sheet/tab to house the SQL Statement. I will start by typing in the full statement I expect in to A1, just to use as a reference as I build out the statement in the cells below.
I then break the statement out line by line, using column A for the variables, and column B for the statements and column C for the joining of statements with variables.
Finally, I use the TEXTJOIN function in cell A4 to join together all of the rows in the combined section. I used a space as the delimiter (” “). This ensures proper spacing throughout the resulting SQL statement.
I then make cell A4 a named range called SQLStatement.
See image below to see how I have achieved all of this.
I have included some helper/formula notes on how to format the variables, since the SQL statement has to be properly formatted in order to work.
VBA Code for Executing SQL Statement and Importing the Data
Open the VBA editor (Alt + F11).
Add a new module.
Add a new subroutine. I’ve called mine SQLPull.
Very important step – enable the required references. Go to the Tools menu and select References. Select the ActiveX Data Objects 2.8 Library and Recordset 6.0 Library – see the last two checked in the image below (yours may be different versions). Click OK to save.
Here is an overview the VBA code I wrote, that is pasted below.
Note that it will connect to the database you identify after you update the connection string if needed.
It will then execute the SQL select statement and grab the recordset.
The code will then write the headers from the query into the cells identified.
Next, it will paste the rows that are returned by the SQL query, starting in the specified cell.
Finally it will close the connection and end the subroutine.
For my applications of this, I like to switch to manual calculation and turn off screen updating because I have found it improves the speed of loading the data. You may choose to leave these alone if working with less data.
I have added commentary and explanations throughout to hopefully help you to modify as needed to support your own needs.
Sub SQLPull()
‘* www.bonbonsguide.com * ‘Importing Data into Excel using a SQL select statement in a cell
Dim Conn As New ADODB.Connection Dim mrs As New ADODB.Recordset Dim DBPath, sconnect, sqlstring As String Dim icols As Long
‘NOTE: ‘If you are querying a SQL Server or Oracle DB, use the name of the database: ‘DBPath = YourDatabaseName
‘If you are querying an Access Database, use the path to the file in quotes: ‘DBPath = “\myfileserver\Bonbon\MyAccessDB.accdb” OR “F:\Bonbon\MyAccessDB.accdb”
””””””””””””””””””””””””’ ‘Connection String ””””””””””””””””””””””””’ ‘The DSN is the existing ODBC connection on your PC – this must be set up first!
‘Uncomment the applicable sconnect string for your database and modify as needed. For MS Access, no modifications should be needed.
‘SQL Server using Windows Authentication: sconnect = “Provider=MSDASQL.1;DSN=STOREDB;DBQ=” & DBPath & “;HDR=Yes’;”
‘ORACLE Connection using an UID/PWD: ‘sconnect = “Provider=MSDASQL.1;DSN=WAREHOUSE;uid=bonbonsguide;pwd=helpsus;DBQ=” & DBPath & “;HDR=Yes’;”
””””””””””””””””””””””””””””””””””””””””””””””””””””’ ‘Set Timeouts (These may not be required in your environment) ””””””””””””””””””””””””””””””””””””””””””””””””””””’ Conn.ConnectionTimeout = 200 Conn.CommandTimeout = 200
””””””””””””””””””””””””’ ‘Connect to datasource ””””””””””””””””””””””””’ Conn.Open sconnect
””””””””””””””””””””””””’””””””””””””””””””””””””’ ‘VBA get SQL Statement from Sheet/Named Range ””””””””””””””””””””””””’””””””””””””””””””””””””’ sqlstring = Range(“SQLstatement”)
”””””””””””””””””””””””””””””””””” ‘Get the recordset – this command will execute the SQL Statement’ ”””””””””””””””””””””””””””””””””” mrs.Open sqlstring, Conn
”””””””””””””””””””””””””””””””””” ‘Return the Header Names ‘”””””””””””””””””””””””””””””””””’ ‘If you don’t need the headers or are using your own, comment the block out
‘Where Headers will be pasted: ‘Sheet1 = Sheet identifier – use Sheets(“name of sheet”) to use sheet name instead ‘Cells (4 – indicates row 4, + 3 indicates to start in column C) … Edit this as needed
For icols = 0 To mrs.Fields.Count – 1 Sheet1.Cells(4, icols + 3).Value = mrs.Fields(icols).Name Next
”””””””””””””””””””””””””””””””””” ‘OPTIONAL – SPEED UP IMPORT ”””””””””””””””””””””””””””””””””” ‘If retrieving lots of records, it may speed it up if you set calculation to manual during the import process. ‘Setting the screen updating to false may also speed up the import. Comment these out if preferred. Application.Calculation = xlCalculationManual Application.ScreenUpdating = False
””””””””””””””””””””””””’””””””””””””””””””””””””’””””””””””””””””””””””””’ ‘OPTIONAL – CLEAR DATA IN ROWS BEFORE PASTING RECORDSET OR DO OTHER PREP ””””””””””””””””””””””””’””””””””””””””””””””””””’””””””””””””””””””””””””’ ‘Add your code here.
”””””””””””””””””””””””””””””””””” ‘Paste the Rows/Records ‘”””””””””””””””””””””””””””””””””’ ‘Importing rows returned – the range below will be where the data starts – line this up with the headers, one row below. Sheet1.Range(“C5”).CopyFromRecordset mrs
”””””””””””””””””””””””””””””””””” ‘Close the Recordset ”””””””””””””””””””””””””””””””””” mrs.Close
”””””””””””””””””””””””””””””””””””””””””””’ ‘Turn automatic calculation and screen updating back on. ”””””””””””””””””””””””””””””””””””””””””””’ Application.Calculation = xlCalculationAutomatic Application.Calculate Application.ScreenUpdating = True
End Sub
Wrapping Up
I hope this helps you out. Below is the final look of my file for this example. I have added a button for the users to click in order to run the VBA code and execute the SQL by assigning the macro. I have formatted so the data returns in a table for easy manipulation and analysis. I have also updated the general formatting and named the sheets.
To save you time, a copy of the file is available for purchase – just reach out to me for information.
I also have another sample template file available that allows you to put multiple criteria in a list and constructs the query accordingly, searching all items. It even allows for the use of wildcards byautomatically formulating LIKE statements! Exciting stuff! Contact me if interested in purchasing.