Test the Web Forward Paris! 

On October 26-27, the third successful Test The Web Forward event was held in Paris, France. Over 100 local web developers joined 35 W3C experts for a fantastic weekend of  learning, hacking, and writing tests. The momentum is now undeniable and the enthusiasm from the attendees and experts at this event was palpable.

Friday Evening - The Talks

Welcome

Vincent Hardy begin the evening delivering l'accueil chaleureux to a room full of energetic and passionate web professionals. With Test The Web Forward Beijing recently behind us, he gave the group an update on the success of that event.
 
Vincent Hardy
 
Vincent laid out the agenda, which included a series of short talks designed to provide newcomers with the info needed to get started writing tests the next morning.

How to Read a W3C Spec

 

Robin Berjon from the W3C kicked off with How to Read a W3C Spec.
 
Robin Berjon
 
It was a great presentation on what might have otherwise been a very dry topic. With Robin's flair, it was not only very informative but highly entertaining and included great visual aids.  To illustrate the point of why we have specs, he used two slides of a "red button" showing the button spec on the left and the implementation on the right.
 
 

How to Write a W3C Reftest

 
Onto the test writing instruction, I stepped up and presented on How to Write W3C Reftest, a similar talk that I also gave at the SF event. The presentation was step by step tutorial for writing an actual test, using the CSS Transforms spec as an example.
 
Rebecca Hauck
 

Testing With testharness.js

 
James Graham from Opera & author of testharness.js followed with a great walkthrough of how write tests with it.  His talked piqued a lot of interest as was seen in the number of questions during and after his talk.  Also, we had a LOT of JS tests produced the next day!
 
James Graham
 

How to File a Good Bug Report

 
Lastly, Elika "fantasai" Etemad gave her excellent talk on How to File a Good Bug Report.  She also gave a version of this talk at SF and she also got a lot of good comments from the crowd when she finished.
 
fantasai
 

The Lightning Talks

 
We then did a series of lightning talks where a few experts got up and in 5 minutes made a case for tests to be written for specs or projects they are passionate about:
 
  • Michael Brooks had a very cool hacking project planned to convert the Apache Cordova/PhoneGap MobileSpec test suite to testharness.js tests, enabling them to be contributed back to the W3C
  • François Remy from the CSS WG called out that the CSS Values & Units spec is in CR and really needs tests – especially for the new viewport units
  • Arron Eicholz from Microsoft also mentioned that the Backgrounds & Borders spec is in CR and also needs some love
  • Kris Kreuger from Microsoft & HTML5 WG challenged people to jump in and write tests for the behemoth HTML5 spec
  • Odin Hørthe Omdal from Opera then got up and pitched IndexedDB and pointed people to all the materials he provided to get them started
  • Lastly, Patrik Höglund from Google excited folks about writing tests for WebRTC with a quick demo
 
Michael BrooksFrançois RemyArron EicholzKris KruegerOdin Hørthe OmdalPatrik Höglund
 
The lightning talks were a new part of the program and were a great success, evident by the fact that each of these areas had lots of great tests written or converted the next day.  In general, everyone finished Friday evening with a good idea of what they wanted to hack on, how to get started, and who the right experts were for each area.  A quick show of hands before we broke for beer & pizza showed everyone had a plan.
 

Meet the Experts

 
For the remainder of the evening, the attendees and experts mingled and strategized on which specs to target the next day.
 
Meet the Experts
 

Saturday - The Hacking

 

Areas of Focus

 
We divided the testing efforts into 3 categories: HTML (&WebApps), CSS, and Mobile.  In each of those, we highlighted several specs or projects:
 
We were delighted that many more specs were tested in addition to those highlighted:  DOM Events, EventSource, URL, CSS Transitions, Filters, Regions,  and Multiple Columns.
 
In total, this very diverse community wrote tests for 13 specs! Plus, an entire vendor suite was converted and now ready to be submitted to the W3C!
 

Tests Written

 
Hilarity ensued when the preliminary number of tests written tallied up to 404!  However, and like all good testers, we uncovered the bugs and adjusted the total to an even more impressive grand total of 499 Tests!!
 
Here are the numbers broken down:
HTML5 & WebApps – 139 total
- HTML5 spec: 42
- WebRTC: 29
- IndexedDB: 62
- EventSource: 1
- URL: 2
CSS – 214 total
- Transitions: 95
- Values+Units: 54
- Transforms: 22
- Backgrounds+Borders: 24
- Filters: 2
- Regions: 13
- MultiCol: 4
Mobile – 146 total Apache Cordova tests converted
In addition to the impressive number of tests written, several people also hacked on some test infrastructure including improvements to testharness.js, the WebIDL harness, and adding support for test widgets in W3C specs.
 

Favorite Quotes

Heard:

 "Until we came here and did this, we didn't even know where we stood testing-wise"
- Henrik & Patrik, WebRTC Experts
"We have ~12K tests for HTML5. But we need like 1 million. So get crazy and scatter shoot tests at whatever you find in the spec“
- Tab Atkins
"I really want to do this more. Who do I talk to about getting more involved?"
- Attendee

Saw:

 

Special Thanks

 
As with all grass roots movements, this would not have been the success it was without the help & contributions from our esteemed community of experts. Thanks to this great group of people who prepared, traveled, promoted, and came to support the newcomers and hack some tests! --  Glenn Adams, L. David Baron, Robin BerjonMichael BrooksRik Cabanier, Julien Chaffraix, Arron EicholzEmil A.Eklund, Elika EtemadSylvain Galineau, Israel Noto Garcia, Daniel Glazman, James Graham, Patrik Höglund, John JansenHenrik Kjellander, Kris Krueger, Tobie Langel, Peter Linss, Divya Manian, Larry Masinter, Larry McListerAndre Jay MeissnerOdin Hørthe Omdal, Jérémie PattonnierSimon PietersFrançois RemyDavid Rousset, Dirk Schulze, Alan Stearns, Lea VerouJet Villegas, Levi Weintraub, Mike West, and Steve Zilles.
 
Also, thanks to all the sponsors: Google, Facebook, Microsoft, Adobe, Telecom ParisTech, W3C, Zenika.
 
Extra special thanks to Cyril Concolato at Telecom Paris and to the entire Zenika team for planning such a great weekend.
 
Zenika Team
 
... and to Al Amine Ousman at Zenika for this beautifully produced video that captures the weekend perfectly:
 
 

Photos

     

     

   

About the Author

Avatar of Rebecca Hauck

Rebecca Hauck - Adobe, CSS Working Group

Rebecca Hauck is a Computer Scientist at Adobe Systems with over 15 years experience in testing, methodologies, automation & infrastructure. She is a WebKit contributor, with contributions to test infrastructure relating to the W3C. She is also an active test author on several CSS specifications and a member of the CSS Working Group. Rebecca has been key member of the Test the Web Forward community since its inception as an organizer and speaker at several events.

In her free time, she can be found riding her bike hundreds of miles through the hills.

Follow her on Twitter at @rebeccahauck.