A new beginning

Palantir

Today is my last day at Morris DigitalWorks. After a ten-year run in the newspaper industry, I am leaving to work full-time with Drupal development.

I am joining the team at Palantir, where I will be doing some programming, training and consulting for Palantir and their growing client list.

Tiffany Farriss and George DeMet have put together a great young team, and I am very excited to be coming on board. The company just moved into its new offices in order to keep up with demand for their award-winning services. Palantir is hiring more developers, too.

I also get to work with Larry Garfield, whom I greatly respect. We worked together on the GoPHP5 project, which helped chart a course for the future of Drupal.

For me, the decision came down to priorities and passions. I think that the Drupal community can do some amazing things, especially supporting the goals of free speech and freedom of information. I will continue working on the Knight Drupal Initiative as a central part of my Drupal contributions.

I am staying in Augusta, where my wife is about to start an exciting new career as well. More details to come over the next week or so, as I get organized in my new home office.

Wow, those people are angry

Lots of newspapers (and maybe the state of Kentucky) are banning anonymous comments.

Perhaps this site is why.

Drupal at Nexpo

For those who don’t know, Nexpo is a gigantic trade show put on by the Newspaper Association of America every year. Over at my day job, I’m a member of the NAA, and this interview was with the NAA monthly trade magazine.

drupliconsmall.png nexpo.png

As a result, I will be at Nexpo, invited by Rich Forsgren to appear on a panel to discuss “Content Management — A Technology Perspective.” I will be the open-source voice on the panel, which should include industry heavyweights SaxoTech, DTI, and other vendors of proprietary software.

I will, as usual, be taking the stance that open-source is good for business and that it aligns with the core goals of journalism: namely the free exchange of information in order to build better communities. This should be a lot of fun.

For those of you in the Washington, DC area, I will be in town for three nights [April 12 - 14], so make your dinner reservations now.

Why Drupal? (Knight Foundation, part three)

While we were all off having a good time at DrupalCON, there was a Knight Digital Media Center conference going on at the University of Southern California.

The initial topic of the day — setting the stage for the rest — was covered by Amy Gahran at Poynter. Michael Williams of the University of Maryland introduced some Zogby polling data about the trend towards digital news consumption — and its adverse effect on the traditional media industry. Go read Amy’s notes, I won’t rehash them here. But I will pull this quote from the Zogby report:

“Americans recognize the value of journalism for their communities, and they are unsatisfied with what they see. While the U.S. news industry sheds expenses and frets about its future, Americans are dismayed by its present. Meanwhile, we see clearly the generational shift of digital natives from traditional to online news - so the challenge for traditional news companies is complex. They need to invest in new products and services - and they have. But they’ve also got to invest in quality, influence and impact. They need to invest in journalism that makes a difference in people’s lives. That’s a moral and leadership challenge - and a business opportunity for whoever can meet it.” – Andrew Nachison, co-founder of iFOCOS

The Knight Foundation announcement at DrupalCON was about this: getting more people involved in re-creating the business of journalism, so that communities can be made stronger.

One of the challenges to Drupal, by the way, is to determine where (or if?) we fit into the larger ecosystem of digital news innovation.

Drupal and the Knight Foundation (part two)

We had a very successful BoF on Wednesday. The goal was to discusss how the Drupal community would manage our relationship with the Knight Foundation.

For those who were not at DrupalCON, here are the basics:

– The Knight Foundation (KF) provides funding for open-source development, products and innovations that are in line with their core goal: improving communities through the free exchange of news and information.
– KF needs help from the community to review proposals that are specific to Drupal.
– The program will be ongoing, with the deadlines and length of projects to vary on a case-by-case basis.
– KF handles all the project management and grant management issues for accepted proposals.
– The Drupal community will try a two-step process for applications.

1) Submit an idea for community consideration.
2) Ideas that get community support will become project issues in a special project queue. These proposals will get serious review from the community in preparation for passing to the KF for final evaluation.

Let me stress that this is not a contest; it is an ongoing program that is an extension of work that KF is already doing. They are looking to the community to help, since we agree that Drupal and KF share some common goals, particularly about the purpose of open-source software and the desire to enable open communications.

There will be some additional detail forthcoming over on g.d.o in the KF group. For now, you can see the meeting minutes from the BoF.

In summary, here is where we stand on the process:

– Moshe and Josh are working on some CCK and voting widgets for use in submitting proposals via g.d.o.
– Gary Kebbel and his team are working on some language so that we all know exactly what types of projects they wish to fund.
– I will be creating a project page on drupal.org.

We are going to have a check-in on or about March 21st, to make sure that we are on track with the work to be done. At that checkpoint, we will create the next round of tasks — which will be focused on three aspects:

– Defining and communicating the goals of the program.
– Marketing the program to the community.
– Lining up volunteers to help manage the process.

I have to say that I am very excited about the potential here. And I think that the members of the KF who participated in the BoF were equally excited to see how the community responded and began to self-organize.

As a final note, let me stress that this will be an open process. We are striving for complete transparency regarding the proposals and the process for recommending them to the KF. If you were not at DrupalCON and want to participate, come on over and join the KF group. Everyone is welcome.

DrupalCON: News Industry Meetup

As previously announced, there will be a News Industry meetup on the first night of DrupalCON. I’m pretty excited, as it is a great chance to meet some folks working on projects similar to ours.

Well, Jeff Anderson of HamptonRoads and PilotOnline reminded me that I never announced any of the details of the meetup. So, without delay, here’s what you need to know.

LOCATION

The News Industry event will be held at Lucky’s Lounge at 7:45 pm, Monday, March 3rd. Working with the folks from Development Seed, we’ve reserved the lounge for the night.*

355 Congress Street
(between A St & Pittsburgh St)
Boston, MA 02210
(617) 357-5825
Google Map


View Larger Map

Looking for people who use Drupal the way that you do? If you’re in the news business, come meet up with industry professionals, thought leaders, and Drupal experts. We’ll have representatives from some of the leading sites on the Drupal platform, including:

* The Knight Foundation
* NowPublic.com
* SavannahNOW.com
* Page6.com
* BlufftonToday.com
* Newspapers on Drupal
* Hampton Roads / Pilot Online
* Vineyard Voice
* The Island Packet (Hilton Head, SC)

And many, many more.

* Note that other industry networking events will occur at Lucky’s before 7:45, so plan to arrive between 7:45 and 8:00.

Special thanks to Bonnie at Development Seed for doing the heavy lifting on the venue!

Open source, journalism and freedom

Attached is a copy of the presentation that I gave to the New York Press Association back in September. The summary is “Using open-source software is a moral imperative for news organizations, because doing so help spread freedom of speech and encourages the open exchange of ideas.”

picture-2.png
A slide showing the number of registered Drupal users from notable countries identified as repressive of free speech by Reporters Without Borders.

The presentation is a PDF. I generally use images and then talk, so this is a little short on words and may be hard to follow. Some notes:

– I gave this three days after DruopalCON Barcelona, so the first slide is about what we did in Barcelona.
– That is a picture of Correfoc, part of Barcelona’s annual festival La Merce.
– I removed a picture of a specific person because I have not asked his permission.

The talk was well-received, and I appreciate the NYPA allowing me to give it.

Get a copy of the presentation. [PDF file, 19.1 MB].

Presstime interview on newspapers and open source

An email-based interview that I did with Mark Toner appears in this month’s issue of Presstime, the magazine of the Newspaper Association of America.

share2.jpg
Photo illustration by Presstime. Photo by Diana Porter

My involvement focuses on Drupal development, of course. But there are also interviews with Adrian Holovaty about Django and Robert Cauthorn of CityTools.

Since this is my blog, here’s the full text of the interview portion. Mark’s questions are set off with —–. [Note: I wrote this between Dec. 3 and 6th, and have made minor corrections, indicated by brackets.]

————
Can you give me a bit of background about Morris DigitalWorks’ work
with Drupal? Was this its first foray into open-source? What were the
rationales for doing so? What’s the broad timeline we’re talking
about?
————

As a web hosting and services company, we have been using open source tools such as Apache since we started in 1995. Open source IT projects are nothing new. Many server-level applications run on open source. It is only in the last 5 or 6 years that the “LAMP” stack — Linux, Apache, MySQL, and PHP — has become so prevelant on the web.

We started looking at open-source content applications back in late 2004. Bob Gilbert, who ran our Strategy division, asked me to look at open-source content management applications. We were specifically looking for a way to get products to market faster.

In 2004, I looked at 10 or 12 open-source applications that would run on Apache, MySQL and PHP — Drupal, Mambo, Geeklog, Absolut, Typo3, Xoops, to name a few. The two standounts were Mambo (since relaunched as Joomla) and Drupal.

I was especially drawn to Drupal because it provides an open, extensibile framework for application development. In some ways, it is more similar to development tools like Symfony, Cake, or Django than it is to a piece of content-management software. (Note: We also use Joomla for instances where community interaction is not a requirement.)

The first Drupal application we launched was in late 2004. The site was an intranet for our advertising sales force. That site is still running today, in fact. It gave us a good low-risk test of the platform and let us install our first LAMP server.

That experience turned out to be lucky, because at the beginning of 2005, we learned of the plan to launch the Bluffton Today newspaper to replace the old Carolina Morning News. We had about six weeks to build the entire site. Drupal allowed us to do two very important things:

– Get a robust community site online very quickly.
– Discard some legacy thinking about what “newspaper web sites” should be.

Ironically, I was working on other projects during most of the build out. Steve Yelvington and Ed Coyle did most of the work without any prior Drupal experience.

After the success of Bluffton Today, we were looking to see if the platform could be used to power a more traditional (and larger) newspaper web site. When the idea came around to redevelop SavannahNow, we pushed hard on the Drupal platform to see if it could support the vision that Heather Nagel-Doughtie and Darryl Kotz had for the site.

SavannahNow has had a mixed result. Drupal 4.6 (the current version is 5.3) was not quite ready for what we wanted to accomplish. We made numerous mistakes in trying to force functionality into the software. In some cases, that functionality has been added in alter releases. In other cases,. we backed ourselves into a tech corner.

————
My understanding (which may be wrong — and *please* correct me if it
is) is that Morris Digital developed its MySite framework for Drupal
and then contributed much of that work to the open-source project. Can
you give me a sense of both the process involved in doing so, and any
discussions that happened around the idea of essentially giving back
to the broader development community?
————

I developed MySite with Morris DigitalWorks blessing. All of the MySite work has been contributed back. The project intended to do two things:

– Give a project back to the Drupal community.
– Push our ability to provide custom content to our site users.

The discussions, really, are about participation. What people sometimes fail to grasp about open-source is that it tends to be a meritocracy. Decisions get made by small groups of trusted individuals. If you participate in the process of decision-making, it is a lot easier if you have some “code equity” in play.

To ge the most out of Drupal — or any similar project, really — you need to be an active participant in the community. MySite was the most obvious example, but we have other MDW employees who help in Drupal support forums, file bug reports, write documentation and submit occasional code patches.

The strength of open-source is that everyone contributes a little bit, and those contributions add up to a greater whole than an individual or small team could hope to develop. So the basic idea is that any contribution that you make will come back to you, exponentially, and sometimes in ways you don’t expect.

For example, Drupal users are obsessive about web standards and about keeping up with the latest developments in web development. Open Social [Open ID] support in Drupal 6 is a good example, as is some Facebook integration work.

I should also note that, as a company interested in journalism, we are also helping to support access to free software that helps people write, publish, and distribute content despite government objections. I did a talk for the New York Press Association where I noted the significant number of Drupal users in countries such as Egypt, Myanmar, and Iraq, where democratic ideas of freedom of the press are not supported. The international support of platforms like Drupal, however, has the effect of spreading access to technology that enables free speech.

————
I’m trying to get a general sense of what it’s like for a newspaper
company to develop code and interact with the open-source community –
the pros and cons. Is the process one traditional applications folks
who work for newspaper companies would be familiar with?
————

I’m not sure that I’m qualified to answer that, since I am not a developer by training. I think news industry people will recognize the sort of democratic, town-hall forums process that leads to decisions being made.

But, in terms of individual project development, there is a framework — a rule set if you like — and you are free to play within those boundaries as you see fit. The only time that development gets contentious is when debates arise over how to accomplish specific tasks within the core Drupal framework.

For example, I just submitted a patch that takes content access controls — the Drupal “node access” system — in a new direction. I think it’s the right direction, but I don’t have final say. That is a community decision. Some developers might find that sort of constraint frustrating.

————
Moving away from the development of open-source projects to the
implementation, what are the pros and cons of a newspaper adopting
Drupal or another open-source CMS? Can you give me examples of how
Morris has worked with its papers on the rollout/refinement of these
products? How does this differ than a traditional vendor installation?
(Beyond the obvious, I mean). How much do the folks at individual
newspapers contribute to the refinement/development of open-source
projects, either in terms of coding or feedback?
————

The obvious pro is that your development team goes from a few to hundreds overnight. Instead of relying on an internal — and isolated — team of developers, you can tap into a network — often a worldwide network — of developers. That means you have developers and small teams working on problems that you haven’t even envisioned yet. And you have far greater resources for horizon watching, keeping up with new technologies, and security fixes.

It may seem contrary to some, but open-source projects have a [much] higher security level than most closed projects. That’s simply a fact of the number of eyes looking at the code and, frankly, the ease of sending attacks at openly published code. More openness means more focus on security holes.

The con side to the argument is a little more complicated. For one, you lose absolute control over the project. You can influence the direction of open-source, but only if you participate as an equal partner. You really can’t come in to an existing community and impose your will — not even by throwing money around, though that can help.

So you need to be patient and realize that you won’t have all of your needs met by the open-source community. Personally, I find that forces us to reconsider the requirements that we draft for a project. Our experience in launching Drupal projects almost always skews towards simplicity. The platform has enough features and flexibility that it meets most use-cases. I generally say that Drupal solves 70% of our problem out-of-the-box. The question that remains is: how important is that last 30%.

As opposed to traditional vendor rollouts, there are two factors that are crucial. First, you have total control over the source code. That means you can make modifications, additions, and enhancements to the system as you see fit. And the barrier to entry — some PHP coding — is fairly low, so you gain some agility and speed-to-market over waiting for a vendor to produce a featiure for you.

But for organizations without PHP developers, it can be a real problem, because there is also no inherent support with open source other than the community.

And for publishers or CTOs who are used to dealing with SLAs and contractual support 24/7, the jump into a self-supporting user community can be a real challenge. There are some companies that you can hire to provide support, and I suspect that we’ll see even more of them arise to meet enterprise-level support needs.

After the rollout — or often during testing — we get valuable feedback from the properties as they are testing the new systems. Sometimes these are workflow issues; some are UI issues. In the best cases, we are able to make the changes and feed them back into the overall Drupal development cycle. When we built SavannahNow on Drupal 4.6, we uncovered a handful of scalability issues that have been addressed quite nicely in the 5.x and 6.x release series.

————
Much of the open-source activity seems to center around CMSes. Are
there other types of open-source software you’re familiar with
newspapers using or experimenting with? If not, are there applications
where you see potential opportunities for open-source projects?
————

Well, you should ask some IT guys — the folks who run the web servers and the pre-press software and the presses. Open source is all over the newspaper industry, CMS is just more public, so it gets more attention.

Honestly, I don’t have time to catalog the list of open-source projects that might be of benefit.

I do see a lot of opportunity in the intranet and business logic space. There are some interesting open-source CRM systems, and I’ve been using Drupal to solve some contract management hassles. I also know of some Drupal projects designed to run server management, which have some interesting potential.

The other big thing that needs to come out of the open-source CMS space is a workable model for web-to-print workflow. The application that nails that will make a giant leap forward.

For those of you who read all the way to the end, come to DrupalCON Boston and the News Industry meetup, March 3rd - 6th. I’ll be happy to talk Drupal, open source, and newspapers with you.

Drupal and journalism

I like it when other folks go on rants so that I don’t have to.

Poynter Online columnist Amy Gahran lets fly at journalism schools who teach students to use DreamWeaver:

Dreamweaver is a decent Web design and development tool. However, it’s not very relevant to journalism, because it does not include a robust content management system! Apparently, this j-school (like many others) offers little or no training in true CMS-based tools. Their online courses focus on Dreamweaver.
….
If your journalism classes are part of a larger communications program, I think clarifying which tools are right for the job is even more important. The journalism class projects should focus on CMS tools like Wordpress or Drupal. Leave the teaching of Dreamweaver to the PR and advertising classes, where it’s much more relevant to the kind of sites created in those disciplines.

For those of you following along, this sentiment is one of the reasons why the Knight Foundation is interested in Drupal.

Knight Foundation coming to DrupalCON Boston

Knight Foundation

You may have heard that the John S. and James L. Knight Foundation will be a Platinum sponsor at DrupalCON Boston March 3rd - 6th. What you may not know is what the Knight Foundation does and how they are connected to Drupal.

Knight Foundation’s signature work is its Journalism Program. Since 1950, the foundation has invested more than $300 million to advance quality journalism and freedom of expression worldwide. Today, the program focuses on leading journalism excellence into the digital age. We define journalism excellence as the fair, accurate, contextual pursuit of truth. [more]

I spoke to Gary Kebbel, former head of AOL News and current journalism program officer at the foundation. Among his duties, Gary runs the Knight News Challenge, a $25 million contest to find digital news innovations that are used to create community in a given geographic area.

In 2006, Drupal-based projects by Benjamin Melançon and Lisa Williams were both funded by News Challenge grants.

2007 was the second year of the Challenge, and while the winners won’t be announced until May 14-16 at the Interactive Media Conference in Las Vegas, Gary tells me that this year featured a large number of outstanding Drupal proposals.

Since the Knight Foundation is a strong believer in Open Source and sees great potential in Drupal, Gary thought that DrupalCON was a perfect chance to:

  • Explore the Drupal community
  • Give back to Open Souce through funding
  • Announce the next big initiative

Now, I can’t say what the next big initiative is — only that it is very exciting for the Drupal community. Over at the Newspapers on Drupal group, we’re thrilled to have the Knight Foundation involved.

Gary and I are planning a session at the conference to discuss the Knight Foundation, and we are both going to be at the News Industry meetup on Monday the 3rd.