Sr. Software Engineer at Microsoft with over ten years of experience architecting and managing scalable, distributed, high traffic web applications. Creator of http://RequestReduce.com Web Optimization Framework and http://nquant.codeplex.com PNG Quantizer. Matt has posted 1 posts at DZone. View Full User Profile

RequestReduce brings immediate Yslow and Google Page Speed score improvements not to mention a faster site!

11.14.2011
| 4287 views |
  • submit to reddit

Since March I have been working in my “free” time on a framework to reduce the number and size of HTTP requests incurred from loading a web page. In short it merges and minifies css and javascript on your page and automatically sprites and optimizes css background images. All this is done on the fly (with caching) with no code changes or configuration required. All processed and reduced resources are served with far future caching headers and custom ETags.

In August I had something solid enough to push to production on Microsoft’s Gallery platform (what brings home my bacon) which hosts the Visual Studio Gallery, the MSDN Code Samples Gallery, the Technet Gallery and Script Center and many more galleries. In November, RequestReduce was adopted by MSDN and Technet Forums and Search which serve millions of page views a day.

Results on Microsoft Gallery Platform

I’m very pleased with the results. We saw an 18% improvement in global page load times. We have a large international audience and the further you are from Washington state the more you will benefit from this improvement. VisualStudio Gallery raised its YSlow score from a B to an A and went from 41 HTTP requests to 30. Additionally, our workflow for spriting background images is completely automated.

Results from China Without RequestReduce: Results from China With RequestReduce:

Key RequestReduce WebPage Optimizations

RequestReduce will do the following on any page where the RequestReduce HttpModule is loaded:

  1. Look for background images that it can sprite. This is the process of combining multiple images into a single image and using some CSS syntax to pull in specific images from that single file into a CSS class’s background.
  2. Merge these images into a single PNG that is quantized down to 256 colors and then run through optipng for lossless compression. Unsatisfied with the quality I was getting from the popular opensource quantizers, I created a quantizer based on the Wu quantization algorithm and have released that separately as nQuant on codeplex. This often reduces the image size up to 3x smaller than the original.
  3. Merges all CSS in the head and minifies it. This includes any text/css resource so it includes files like WebResource.axd.
  4. Automatically expands CSS @imports.
  5. Minifies and merges all adjacent javascript on the page that do not have a nocache or no-store header and an expired or max-age less than a week. This includes any valid javascript mime type file so ScriptResource.axd and WebResource.axd are included.
  6. Manages the downloads of these CSS and image requests using ETag and expires headers to ensure optimal caching on the browser.

Other Great RequestReduce Features

Since I wanted to deploy RequestReduce on Microsoft websites, it obviously needed to scale to Millions of page views and be maintainable in an enterprise environment. To do this RequestReduce supports:

  1. CDN hosting of the CDN and Sprited images.
  2. Synchronizing generated CSS and image files across multiple servers via a Sql Server db or a distributed file replication system.
  3. Custom API allowing the addition of your own minifier or filtering out specific pages or resources.

Of coarse RequestReduce works perfectly on a small site or blog as well. This blog went from a YSlow C to an A after using RequestReduce.

Why I Created RequestReduce

First, I’ve been looking for an idea for quite some time to use for an Open Source project. This one struck me while on a run along the Sammamish River in February. Over the past 10 years I have worked on many large, high traffic websites that used somewhat complicated frameworks for organizing CSS. These often make including simple minification an impossible task in a build script especially if CSS can be changed out of band. Also, image spriting has always been difficult to keep up with. New images get rolled in to CSS and we are too busy getting features out the door; so spriting these images falls through the cracks. To have a process that did all of this automatically and at run time (Note: RequestReduce does not block requests while it does this. That would be a perf catastrophe. See here for details.) seemed ideal. I wanted a plug and play solution. Drop a dll in the bin directory and it just happens.

RequestReduce makes this vision come very close to reality. In this version, there are some things that RequestReduce expects of the CSS class containing the background image in order to successfully sprite it. In a future release I will be taking advantage of CSS3 which will mean RequestReduce will be able to sprite more images on modern browsers. The Microsoft Gallery sites have to support IE 7 and 8 so the first release had to be CSS2 compliant.

RequestReduce is now available for community use and contributions

To get started using RequestReduce:

  1. If you have Nuget, simply enter this command in the Package Manager Console and skip steps two and three:
    Install-Package RequestReduce
    Otherwise, download the latest RequestReduce version.
  2. Extract the contents of the downloaded zip and copy RequestReduce.dll as well as optipng.exe to your website's bin directory. (If for some reason you cannot put optipng.exe in your bin, RequestReduce will function as expected but will skip the lossless compression of its sprite images.
  3. Add the RequestReduceModule to your web.config or using the IIS GUI
  4. Optimize your CSS to help RequestReduce better locate your background images
  5. Optional: Configure RequestReduce. You can control where generated css and sprites are stored, there size thresholds and specify a CDN host name to reference You may also fork the RequestReduce source code from its github site.
    For links to RequestReduce documentation, bug reports and the latest download, you can visit http://www.RequestReduce.com. I’d be very interested in hearing any feedback on the tool as well as any problems you have implementing it. I plan to be continually adding to this project with more features to reduce HTTP Requests from any web site.
Published at DZone with permission of its author, Matt Wrock.

(Note: Opinions expressed in this article and its replies are the opinions of their respective authors and not those of DZone, Inc.)

Comments

Kode Ninja replied on Tue, 2011/11/15 - 1:22pm

Have you checked out something like Torbit or CloudFlare?

Matt Wrock replied on Tue, 2011/11/15 - 2:05pm in response to: Kode Ninja

I am familiar with several of the commercial offerings like the two you mention. Many of these are great products but they are not free and are closed source. Some are easier to setup than others but there are some that require hardware or DNS changes that many may find overly intrusive. While, currently, RequestReduce cannot match some of the features of the commercial products, the goal of RequestReduce is to provide the best free OSS solution in this space. I believe that right now it accomplishes that and I have a backlog about a mile long that could make it tons better. Hopefully some added community involvement can increase this velocity. I am very open to pull requests at https://github.com/mwrock/RequestReduce

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.