Results from our Developer Survey #2

To follow up on the developer survey from last November, we did a second survey this past March after the releases of Firefox 3.6 and Firebug 1.5 to gauge developer reactions to the latest features in the browser and a much improved version of everyone’s favorite developer tool.

In this post we’ll share the results of our latest survey and provide some data and insights from all the great feedback we have received.  We hope this will help us better understand developers’ needs and continue to build out the Mozilla Developer Network to better engage with them.

Recap of the November 2009 Survey

As a refresher, here is a summary of the initial November 2009 survey. The main takeaways were as follows:

  • Our community is made up of a diverse set of developers that cover all aspects of web development from design to back-end work.
  • Open standards are by far the most popular technologies used for web development work.
  • Firefox is the most common browser used first by developers for testing their work, primarily because of the many developer tools and Add-ons available for Firefox and Mozilla’s strong support for web standards.
  • Firebug stood out as the most popular developer tool and many developers agreed that it is “absolutely essential for development.”

Results from the March 2010 Survey

Our second developer survey received 2,267 responses over two months from late March to early June.

For this survey there were several common questions from the previous one  – about browser preferences – so that we could measure satisfaction over time and follow trends in browser adoption following the release of Firefox 3.6.
We also responded to the overwhelmingly enthusiastic praise of Firebug by asking for feedback on the most recent release.  By obtaining more specific feedback on the latest version of Firebug, we hope to address any remaining issues to make it an even more effective and attractive tool for developers.

Developer Browser Preferences

We did not see much change in browser preferences from November 2009 to March 2010.  Even considering a new iteration of Firefox and increasing competition from other browsers, the data still reflect general browser market share trends: the latest versions of Firefox and Chrome gained at the expense of older versions of IE.

The following data show the primary browsers developers use to test their websites:

Which browser(s) do you test your web sites against to make sure they are compatible?

November 2009


Tested Against
Percent
Firefox 3.5 82.03%
IE 8 74.63%
IE 7 68.23%
Chrome 60.23%

March 2010

Tested Against Percent
Firefox 3.6 80.17%
IE 8 70.23%
Chrome 62.37%
IE 7 56.18%

The numbers are unlikely to shift drastically because regardless of developers’ personal preferences, the top browsers listed above are the ones most commonly used by regular users, as demonstrated by browser market share data. Thus it makes sense that developers test against these browsers most often.

Firefox isn’t just the most popular browser for developing, according to the data below; it’s also popular for personal usage. It should be noted, however, that this survey was distributed primarily though Mozilla-related channels, so there might be some bias in the results; we address this problem later in the report.

Note also that the vast majority of developers were quick on the uptake switching from 3.5 to 3.6.

Have you tried Firefox 3.6?

Upgrading to Firefox 3.6

Although the vast majority of developers switched from 3.5 to 3.6, there were still some who did not. In fact, roughly 10% of the March survey respondents still used 3.5. The primary reasons for the continued usage on 3.5, however, had little to do with personal preference. Roughly half of those who still used 3.5 did not even know that 3.6 was released, while the other half responded that they didn’t have time to update.

One interesting note from the results was that a lot of developers still using Firefox 3.5 were on Linux distros that did not yet have the Firefox 3.6 package available at the time they took the survey.  Given that 23% of respondents develop on the Linux platform, that could explain why so many had not made the jump.

What operating system do you mainly use for your development environment?

Unfortunately the data lacked specific details on why developers did not know about 3.6 or why they did not find time to update to the next version.  With that said, regardless of the reasons, it is clear we should focus on facilitating the update process for future iterations of Firefox.  We will start by promoting early betas and announcing new Firefox releases on the MDN website.

Feedback on Firebug 1.5

We all know that Firebug is important to developers, so we wanted to focus on getting Firebug-related feedback for this survey. Comments about Firebug echoed those from the November survey: the consensus is that “Firebug is the single most important tool in web development.” Indeed Firebug is considered such a critical tool in the developer’s arsenal that several of you asked us to package Firebug as a built-in component of Firefox instead of just as an Add-on; some users call the duo the “triple F”: Firefox and Firebug.

While the 1.5 release was a huge improvement from previous versions, developers weren’t shy about sharing their frustrations and feature requests.  Many noted occasional stability issues, such as when Firebug is finding elements in document trees or taking certain Ajax requests. Additionally, we received several suggestions for improving the user interface, such as incorporating more Firefox-native design elements, increasing the size of the “Deactivate Firebug” button, and removing elements like the “Quick Info” and “CSS Overview” boxes.

One data point that stood out was that about 22% of developers had not tried Firebug 1.5 at the time they took the survey.  Considering that it was released in January and the survey was open from March to June, we would have expected that the adoption of such an important tool to be higher than what the data suggests.  This presents an opportunity to better communicate new releases and raise awareness among developers to make sure they are up-to-date on the latest development happening with Firebug.

Have you tried Firebug 1.5?

For those of you who are interested in learning more about documentation, features, and related news, visit the Firebug website.  Along with regular blog posts from the team, the site will host community forums for discussions with community and Firebug team members and offer ways to get involved if you want to contribute to the project.  Firebug 1.6 development is well underway and we’ll continue to see it evolve to meet web developers’ needs.

Next Steps

Thus far your feedback via our first two surveys has been invaluable as we strive to build a better open Web through the Mozilla Developer Network.  We now have a decent snapshot of the type of development you do, the technologies and tools you use, and the browsers you prefer for both work and personal use.  The insights we have gained will help us refine the MDN roadmap and guide the programs we develop over of the next year to better engage with developers and build out the MDN website to meet your needs.

Our next step is to move beyond these initial data to get a larger snapshot of the developer community. We will start by designing an informal survey to get a grasp of what developers here at Mozilla and within our immediate community have to say about the tools and resources they find the most valuable for their work.  We plan to follow that up with more research on the web developer community as a whole by distributing an industry-wide survey.

The goal for Q3 is to design a survey that can be distributed to a more diverse and unbiased global developer community.   Ultimately our goal is to have the clearest possible picture of the global web developer community and how it views the current “state of the Web”.



About Jay Patel

I strive to make the web better by making sure those that develop and drive it are happy campers.

More articles by Jay Patel…

About Brian Louie

I'm a computer science student at Stanford, and for the summer of 2010, I'm an intern at Mozilla working on developer engagement.

More articles by Brian Louie…


8 comments

  1. salar

    The new statics shows people attention about google chrome. its developer tools are good but not yet as good as Firebug.

    Mozilla should spend more energy on Firebug instead of creating simple and not full featured developer tools planned for Firefox 4.

    One of most annoying Firebug issues is its Script tab, which has several major and minor issues.

    Thanks,
    Salar

    June 29th, 2010 at 20:36

  2. Dan

    What came as a surprise to me in Firebug 1.5 was that they removed the feature that double clicking an element in the HTML tab let’s you edit the HTML. Now you have to right-click it choose the edit option. Even though i don’t like it that way, what makes it even worse is, that double-clicking an element now does _nothing_. Why did they remove features? I don’t get it.

    July 6th, 2010 at 13:22

  3. Ryan

    Firebug really needs to be built into Firefox perhaps even making it use it’s own process so if it does crash or hang for whatever reason it won’t bring the browser with it.

    July 6th, 2010 at 17:11

  4. Taffy

    Popular extensions like Firebug, ABP and NoScript need a lot of hackery making them have strange issues, compatibility problems with other extensions, etc Supporting these extensions by offering them the APIs they need is certainly the way to go!

    July 7th, 2010 at 06:31

  5. Felipe

    Sidenote on the nov 2009 / march 2010 graphs: please keep the same color for a given browser on the latter viz. If IE6 the green bar is 6th and then Opera is the green one then I’m lost.

    July 8th, 2010 at 13:39

  6. Suzanne

    I’m having issues with rendering discrepancies between FF2.0/3.0 and FF3.6. Is there a Firebug plug-in to test previous versions of FF?

    July 16th, 2010 at 12:56

  7. […] are a web developer or designer, we can use your input. After gaining some great insights from our previous survey on Firefox 3.6 and Firebug 1.5, we have decided to go broader and get a better industry-wide snapshot of web […]

    September 14th, 2010 at 15:11

  8. web development UK

    The new posting related to google chrome, developer tools is fantastic but firebug use to build firefox.

    September 29th, 2010 at 04:45

Comments are closed for this article.