Using Parameters With Web Queries

This article has been posted on the Microsoft Excel team blog on MSDN too.

Introduction

Excel provides a very useful option to gather data from websites, called web queries. These have been introduced with Excel 97 and have been further enhanced in the versions released after Excel 97. This article shows how you can setup a web query so that you can make the worksheet dynamically update based on values in so called parameter cells.

Setting up the web query

Setting up a web query is as simple as clicking the Data tab and then clicking the "From Web" button on the Get External Data tab:

Inserting a web query in Exccel 2007

For Excel 2003 and earlier you need Data, Get External data, New Web Query.

You’ll get this screen:

Inserting a web query in Excel

Enter www.bing.com and click the Go Button.

In the search box that follows, enter the word Question and hit enter. The screen refreshes and a new url appears in the address box:

http://www.bing.com/search?q=Question&form=QBLH&filt=all

Don’t do anything yet, first click the "Options" button and set the Web Query to return full html results (if so desired): Setting a WebQueries options

If you want these results in your sheet, just hit the import button now. However, if you want an interactive result in your sheet, enabling you to enter new search criteria in a cell, modify the url so it looks like this:

http://www.bing.com/search?q=["Question"]&form=QBLH&filt=all

You have now made part of the url work as a parameter, by replacing that part of the url with some text between quotes and square brackets (this will only work when using the URL would open a normal page in a web browser). The string you entered will be used as both the name of the parameter and the prompt. Excel will interpret the part between the square brackets as a parameter and prompt you for a value once you click the Import button or when you refresh the query table. Now we’re ready to click "Import". If the page takes time to load, you’ll see a progress screen:

Waiting for results

Next Excel asks where to put the results; put them in cell A3 so we have room above the table:

Tell Excel where to put the results

Excel detects we have a parameter and now asks what value you want. As you can see you can select a cell for the parameter, lets use cell A1.

The fun thing is, that you can either fill in a value or you can select a cell as an input for the parameter:

Excel prompts for a parameter value

By checking the two checkboxes shown above, you ensure that Excel will automatically update the query table when you change the content of the cell(s) you selected.

Sometimes, inserting the parameter part in the url fails. In such cases, try modifying the routine called Demo2 as shown below so it has the URL you need and the parameters at the proper positions. Make sure you have the proper cell addresses in place as well. When done, run the routine. You should now be able to use the dynamic web query.

Working With Web Query Parameters In VBA

Excel VBA offers the programmer access to web query parameters through the Parameters collection of Parameter objects.

Unlike "normal" database queries, it is not possible to add a parameter to the Parameters collection using the Add method (though even for that type of query, doing so is an awkward process).

Instead one has to add all parameters one needs to the Connection string. Excel will determine the number of parameters from that string once it has been applied to the Connection property and then the Parameters collection becomes available to VBA. In the example below, a web query is added to a worksheet. The message box shows, that there are no parameters:

Sub Demo()
    Dim oSh As Worksheet
    Set oSh = ActiveSheet
    With oSh.QueryTables.Add("URL;http://www.jkp-ads.com", oSh.Range("A3"))
        .BackgroundQuery = False
        MsgBox .Parameters.Count
    End With
End Sub

Result:
Showing the number of parameters

If the code shown above is changed to add a parameter in the connection string, things change:

Sub Demo2()
    Dim oSh As Worksheet
    Set oSh = ActiveSheet
    'Make sure we already have a valid value for the parameter
    Range("A1").Value="WebQuery"
    With oSh.QueryTables.Add("URL;http://www.jkp-ads.com/Articles/[""PageName""].asp", oSh.Range("A3"))
        .BackgroundQuery = False
        MsgBox .Parameters.Count
        With .Parameters(1)
            .SetParam xlRange, oSh.Range("A1")
            .RefreshOnChange = True
        End With
    End With
End Sub

Now the messagebox shows:

Showing umber of parameters

Note that in the code sample the parameter has been tied to a cell (SetParam method) and that the query is set to update when that cell changes (RefreshOnChange property set to True). The SetParam method is the only way to change the setting of the parameter object from e.g. prompt to Range and to change the range the query parameter uses as its source.

Conclusion

As this article shows, adding a parameter to a web query is relatively easy. The tricky part is the fact that you need to know that parameters can only be added through the connect string (the URL) by using a very specific syntax and that parameters can only be added by changing the connection string.

Comments

Showing last 8 comments of 100 in total (Show All Comments):

Comment by: Lou (6/25/2010 1:49:12 PM)

Hi,

Can the web query be refreshed when the Excel sheet is closed?

Thanks.

Lou

Comment by: Jan Karel Pieterse (6/26/2010 6:50:58 AM)

Hi Lou,

Unfortunately, no.

Comment by: mastor (7/16/2010 5:32:32 AM)

i made a web query to update from web every 30 min and i made also some macro i went the macro should run automatically afther refreshed how do it?

Comment by: Jan Karel Pieterse (7/16/2010 6:33:41 AM)

Hi Mastor,

You can schedule a macro that runs every 30 minutes, which refreshes the web query and then calls the subsequent macro to update the remainder.

Sub Update()
    Sheets("Sheet1").Querytables(1).Refresh False
    CallYourOtherMacroHere
    Application.Ontime Now + TimeValue("00:30:00"), "Update"
End Sub

Comment by: ryan (7/16/2010 11:27:12 AM)

when using visual basic for web queries, how do you set it up to maintain HTML formating and any hyperlinks?

Comment by: Jan Karel Pieterse (7/17/2010 2:32:28 AM)

Hi Ryan,

Why not record a macro whilst setting this up?

Comment by: JC (7/19/2010 4:54:08 PM)

hello,

is sub demo(2) intended to do anything other than show a message containing the number of parameter used? as i see [or don't :)] it should call some information from 'www.jkp-ads.com/Articles/WebQuery.asp' and use cell A3 as the starting point from which to display it.

i created a module in excel 2010, copied the code to it, and all i see is the message box containing the parameter count, and 'WebQuery' entered into cell A1. i tried to change the link and parameter value in cell A1 using the vba editor, and i get the same result --- just a parameter count of 1 displayed in a message box --- no other information but the value assigned to a1 appears.

thinking this might have to do with a recent upgrade to excel 2010, i tried this in excel 2003. still no information from the web appears.

do you have any suggestions i could use to make this work for me? or, am i getting the intended result? the permissions in my workbook should allow for this to work.

Comment by: Jan Karel Pieterse (8/16/2010 2:53:22 AM)

Hi JC,

It sets up the query so it automatically refreshes when you change the value in the parameter cell. Does the query refresh when you anter a new value into the cell?

Have a question, comment or suggestion? Then please use this form.

If your question is not directly related to this web page, but rather a more general "How do I do this" Excel question, then I advise you to ask your question here: www.eileenslounge.com.