Example - URL with Form

In previous examples we have used the NASA RSS feed to show how content can be pulled from any URL and manipulated in various ways.

Here we are doing that again, but with a twist. Suppose you have a remote URL that will return data according to one or more parameters in the URL, to create variations in the path and/or query string. Perhaps you want to open that up to site visitors, so the URL pulled and displayed is adjusted according to their input.

To help with any visitor entered variation of the pulled URL, we have the URL with Form content source.

Outline of our example

This example builds on the example for List Picker. If you have not already done so, have a look at that example first as we assume a lot here.

Rather than the URL content source, we use URL with Form. This extends the source to allow substitution of {{tokens}} embedded in the pulled URL. When page is viewed, in the pulled URL the tokens are replaced with equivalent values taken from the page query parameters, or page or user attributes. This is configured with an additional section in the block edit dialog where default values are entered.

Picking an RSS feed

NASA doesn't have just one RSS feed, there are many feeds. For this example, a form with a select element is used with UCP to choose from a list of feeds. It could just as easily have been a text entry or radioset. But we want to make it easy for visitors, so a select element is a good choice here.

The Content Transform and Content Display are the same as previously in the List Picker example. This will work equally well directly or with ajax pulled content.

Before we go into more details, have a play with the example below. Select from a range of RSS feeds and paginate through them.



In more detail

Despite its name, this content source does not provide the actual form. Providing the form is entirely up to you and in its simplest guise could be just an HTML block. This content source responds to parameters from the form you proivide.

Above is a UCP block and immediately preceeding it an HTML block to provide the form. 

<form method="get" class="ucp-attach-form form-inline">
    <select name="feed_path" class="form-control">
        <option value="breaking_news">News</option>
        <option value="educationnews">Education</option>
        <option value="shuttle_station">ISS</option>
        <option value="solar_system">Solar System</option>
        <option value="earth">Earth</option>
        <option value="aeronautics">Aeronautics</option>
        <option value="chandra_images">Chandra mission</option>
    <input type="submit" value="Read" class="btn btn-primary">

The class 'ucp-attach-form' is required for UCP to locate the form and maintain it through pagination. Other classes in the form html are purely for Bootstrap styling. 

In the UCP edit dialog, an additional table of inputs is shown qith an entry for each {{parameter}} you declare in the URL/filepath.

URL with Form

Becuse URL with Form uses {{parameters}}, the similarly marked UCP source pagination parameters {{limit}}, {{offset}} and {{page}} are reserved for use by UCP and cannot be extracted from the query partameters or form.

With all this complexity added to the URL parameters, you are recommended to only use one UCP block that responds to form parameters on any one page.

Use of any of the forms blocks or packages to create a form that is used by this content source may also be feasible, but you will need to disconnect the form display from actually submitting to the form controller. The form simply needs to refresh the page without actually doing anything, so allowing UCP to use the form data without interference.

Furthermore, you don't actually need to have a form on the page with UCP! UCP reads the URL query string data, so you could have a form on another page or simply a hard coded link with a query embedded to navigate to the page with the URL with Form and Universal Content Puller block.

As well as enabling form or url parameter values to be used in a URL or filepath, special key names can be used to embed page or user attribute values. See the source section in Content Sources for details.

Endless Possibilities

While our examples have used RSS feeds to pull data from, UCP and the URL with Form content source are by no means limited to pulling RSS. NASA RSS is simply convenient for setting up some examples.

Some ideas for using the URL with Form content source​​​:

  1. Fetching data from JSON Query sources, with variable {{parameters}} in the query string.
  2. Use a content aggregation service for RSS that accepts search terms, then use form {{parameters}} to allow site visitors to adjust the feed search.
  3. Pull information from a REST API using {{parameters}} to control what information is pulled.

See also the example SQL Data with Form which is based on very similar principles.

Additional Pages

About this Sidebar

Creating a sidebar for a group of pages without messing about with stacks is an easy use-case for Universal Content Puller.

This sidebar is edited once, within the main addon page for Universal Content Puller.

It is then pulled into all UCP sub-pages using a UCP block.

The Content Source is Parent Page, set to pull the Sidebar area from 2 pages from the top. The Content Transform is Selector, set to remove container and row classes that, when unnecessarily nested, could mess up the Bootstrap grid. The Content Display is Plain, which just outputs the transformed text.

In the advanced settings, sanitization is disabled as we trust the source page and don't want to strip out any formatting or functionality from the pulled sidebar.