Global Kids and Hive NYC Badge Design Reflection

This is a guest post by Daria Ng, a Senior Program Associate at Global Kids. Next week she’ll continue her work with international education as a consultant for UNICEF.

Global Kids has experimented with digital badging in various contexts for the past few years. From badging an afterschool program four years ago at the New York Public Library, to badging the Urban Biodiversity Network program at the American Museum of Natural History, Global Kids has used digital assessment to support youth to recognize, talk about, and demonstrate essential digital literacy skills. Currently, we are consulting with three schools as they develop badging systems for their students, developing our own badging system for all Global Kids youth programs, and supporting Hive NYC and Hive Chicago to build their digital badging systems and infrastructures.

For the past year and a half, Global Kids has been navigating the badge universe. Global Kids has followed the growing interest in badges in both formal and informal learning contexts, and been well aware of the questions, confusion, and opposition towards badging as assessment. One thing Global Kids knows for sure is that badging is an iterative, hands-on process—the only way to learn about badges is through their design and implementation. As an organization, we have learned so much through the introduction of badges to youth. We have learned from the schools we work with, our experience this past summer, and by hearing from others who have implemented badging systems. For example, we are in our second year of a badging system we helped implement at the Epstein School in Atlanta for sixth and seventh graders. And this past summer, we badged Global Kids’ geocaching and virtual video program, Race to the White House.

rwh badges

At Global Kids, we have envisioned badge development as an approach to: provide alternative assessment, gamify education, scaffold learning, develop lifelong learning skills, drive digital media and learning, and democratize the learning and credit acquisition process. Read more about each of these six framing guidelines here. Our need to incorporate badges into our learning design, arose out of our observations that youth participants were gaining new skills around leadership, global literacy, digital literacy, and other 21st century learning skills through Global Kids, but when it came time to write resumes, apply for jobs, or draft college essays, they struggled to articulate and identify these new-found skills and instead defaulted to listing their more traditional academic experiences, such as standardized test scores, and report cards. They discounted interest-driven learning, out-of-school experiences and the connected learning that we know to be so important to their academic, civic and professional development.

activist digital advocacy game guru

Funding from The MacArthur Foundation has enabled Global Kids to spend the past year offering in-person professional development workshops to develop digital badging systems for Hive Learning Network members in New York City and Chicago. Trainings consisted of the what and why of badges, incorporating Global Kids’ six framing guidelines in the design process, recommendations for badge integration and workflows, member updates, and use of badge-based learning programs such as BadgeStack. We built a community site and listerv where Hive members doing badging work can post updates and share their work, and where Global Kids can also share resources for everyone to benefit from including reports, case studies, etc.

badge training_chi

In addition to training Hive members, Global Kids has also been supported to develop network-level badges for Hive NYC. These badges will serve as a meta-assessment and incentivization system to help the network share learnings and experiences across organizations, programs, and events. While Hive Chicago began with robust discussions about network-wide badges, Hive NYC has been more focused on organizational and programmatic badges. Global Kids and Hive NYC staff began meeting in October 2012 to design a badge that would serve all participating organizations in Hive Learning Networks.

As Global Kids and Hive HQ began the badge system development process, one of our first design decisions was that cross-network badges for Hive NYC should emphasize the learning pathways that connect youth to the experience and dispositions of a meaningful and fulfilling networked learned experience. We were interested in taking the often abstract rhizomatic learning of the network and translating and visualizing it for Hive NYC’s youth participants.

The goals identified were:

  • Track/model the connected learning experience
  • Motivate cross-network participation
  • Increase participation in Hive network events
  • Acknowledge digital media skills/expertise
  • Demonstrate the Network’s key values and behaviors
  • Identify potential learning pathways and opportunities available through the network

When Global Kids began training Hive members, our strategy included sharing what we knew from our experiences, building the badging community within the network, and incorporating member feedback to develop a relevant system that would work for them. Since badging at the network level was new for everyone, we anticipated that there would be a lot that we wouldn’t know, but that we’d discover through the process. We didn’t know what kinds of social practices and needs would arise when members started using the system and designing badges for their programs. For example, one need that arose from the membership was a desire to badge for the one-time events and incubator projects organized by partnering Hive organizations.

badge training

Hive NYC’s particular focus on pop-ups, learning events and short-term collaborations indicated a need to issue a network-wide, plug and play system that organizations could use to leverage larger thinking and learning pathways within the network. After identifying goals, we turned our focus to our end users—the NYC youth that participate in Hive NYC programs. We developed user stories to encompass a diversity of young people who we’d met through our programs and events.

Hive NYC User Stories

Zakia is a 16-yr old student at Hudson High School. She is an active member of MOUSE and has successfully completed several workshops. Zakia has worked with physical computing, design, and is familiar with HTML and Mozilla’s X-Ray Goggles tool. This summer she was an intern at Hive NYC and increased her HTML and CSS proficiency. She also participated in skill shares with Hive NYC youth from Brooklyn Public Library, Rubin Museum of Art and Summer Code Parties. She has attended Emoti-Con, Maker Faire and a Makerbot workshop at Cooper Hewitt National Design Museum.

Walid is 15 years old. He attended a Summer Code Party event in 2012 with a friend who found out about Hive NYC through Facebook. Walid is into video and loves messing around with YouTube, and had a great time learning about Mozilla’s video remix tools. He’d probably attend more events or would definitely take a workshop—if he knew more about Hive NYC’s focus on youth, making and learning.

After developing about five user stories, we were able to identify several big design questions:

  1. How does youth participation in Hive NYC member programs connect and inform the larger network badge system?
  2. How can we incentivize participation and connected learning while and keep badges meaningful (ie avoid over badging)?
  3. What is the user experience, the look and feel of the Hive NYC badge?
  4. What are the trajectories for badge awards? And how do we make these awards relevant to youth in the network?
  5. What network behaviors should be encouraged?

As we tackled these big questions, the work of Ruth Schmidt, a Senior Designer at Doblin who helped Hive Chicago develop their thinking about the badge process, became very useful for us in NYC. Schmidt’s framework for thinking about badge construction, became a core element and inspiration for our work.

We went through each of the identified steps for badge construction—analyzing each one and determining its relevance for our design process. All of this helped inform our next and most challenging (and time-consuming step): brainstorming, developing, and detailing the youth activities and “challenges” to assess and badge.

Since we know we want the Hive NYC badge system to help youth experience the city and various Hive NYC programs, we decided to use location-based activities to structure the learning pathways of the badges. In its current design, a user must complete an activity or set of challenges either online or during a face-to-face event and submit evidence (a link, blog post, video or document) in order to earn a badge. As a learning laboratory with an emphasis on open, reflective, hands-on making, we felt that tying the badges to specific activities and products was crucial to our approach. So far, each badge and challenge has a youth-facing description. Although the titles have not been user-tested with youth the basic challenges are developed. For example:
HiveologistRecruiterFirestarter

Hive-ologist Badge
Can you represent Hive NYC and explain its who, what, when, why, and how?

Hive-ologist Challenges:

  • Present at a public event and speak about Hive NYC
  • Send in the website links of least 5 Hive NYC organizations
  • Name at least 10 organizations in Hive NYC

Recruiter Badge
You’ve discovered the innate beauty of Hive NYC. You’ve met Hivers and attended Hive NYC events all over the city. Now your job is to convince a friend to take a ride on the Hive NYC crazy train. Caution: learning and making ahead!

Recruiter Challenges:

  • Post a picture or photo of you and your friend at a Hive NYC event
  • Collect a comment of what your friend thought of the event
  • Submit documentation of something your friend made at the event

Currently, we have developed 14 Hive NYC badges and associated challenges, but our work is far from over. Our next steps include:

  • Choosing the right platform for Hive NYC badges
  • Finalizing the badge icons
  • Testing Hive NYC badges at an upcoming event (see below)
  • Gathering feedback from youth and educators

explore create badgeshare

In the spirit of learning by doing, we are testing out Hive NYC badges using the Credly platform at the Level Up Teen Game Jam that concluded yesterday. Hosted by the Museum of Moving Image, the event is held in conjunction with IndieCade East, the National STEM Video Game Challenge, Mozilla’s Game_On competition and Institute of Play’s Gamekit launch. Typical of Hive’s cross-network and interdisciplinary approach, teens will meet professional game designers, play indie and vintage video games, then build their own analog and digital game prototypes, earning digital badges and stickers to mark the achievement of new skills. We’ll be using the event’s focus on prototyping and sharing to assess three skills that are critical to the Hive NYC DNA—exploring, creating and sharing. We’ll be reporting back with more details of how our beta-test and pilot experiences go.

A Late Valentine Gift: The Learning Labs Pop-Up at NYSCI

I spent Saturday representing Hive NYC and Mozilla Webmaker at the New York Hall of Science’s Learning Lab Pop-Up and it was wonderfully surreal at times. I spent five transformative years at NYSCI. I worked on some incredible projects, sharpened many of my ideas about digital tools in education and worked with a plethora of talented, warm and dedicated people.

20130216_174214

In Hive, we talk about networked learning constantly. At times it can seem ephemeral and elusive, but at NYSCI I experienced a heady and visceral example of how it works on the ground. I experienced the network both from an individual view (cross-pollination of jobs, people and ideas) and how it works beyond individuals (diffusion of ideas, pathways for people and expanded participation).

Let me see if I can map this a bit. The event was part of NYSCI’s IMLS Learning Labs Grant. The Learning Lab idea is an attempt to spread the YOUmedia idea and practice. Here alone we see a network: Ideas and programs funded and championed by MacArthur’s Digital Media and Learning and including thought leaders like Mimi Ito (Hanging Out, Messing Around and Geeking Out), Nichole Pinkard (Digital Youth Network/YOUmedia) that have now manifested in two Hive NYC organizations (DreamYard YOUmedia, NYSCI) and inspiring others (Brooklyn Public Library’s Info Commons Space).

The event format, the “Learning Party” or “Pop-UP” was remixed by NYSCI from the model that Hive NYC and Mozilla have developed. The model is inspired in part by the professional hack jams and the informal learning practices Hive embodies. It wasn’t lost on me that we basically used the same space and staff that Jess Klein and I did when we collaborated on an early iteration of this model for the NYSCI/Hive Earth Day Hack Jam three years ago. Add to that the NYSCI team leveraging Hive NYC members and friends like World Up, Pixel Academy and Scratch, and it felt exactly what the Pop-Ups are supposed to feel like: A Hive Learning Network experience compressed into one physical space and a set amount of time that then feeds learning experiences back into the ecosystem.

All of this was housed in NYSCI’s new Maker Space which itself is a manifestation of a web of opportunities and energy, like being the east coast host/driver of World Maker Faire (of which Hive NYC has participated each year) and NYSCI’s commitment to a Making as Learning ethos.

The Maker Space itself is incredible and embraces a wide definition of making that feels deeply participatory. It also sits squarely on their exhibition floor, not separated or siloed from other experiences people are having in the science center (in this case a very cool, youth culture/interest-focused Tony Hawk Rad Science of skateboarding exhibition, you should definitely go and see it.)

The NYSCI Maker Space Buzzing

The NYSCI Maker Space Buzzing

One place where Hive NYC has not been as successful as we had hoped, is in charting network provided pathways for youth to navigate and grow from experience to experience. Ideally these pathways are both self directed by youth and guided along the way by educators, mentors, teachers, organizations and parents. Saturday I saw an example of how these pathways are beginning to emerge and be represented by connected youth. Three teens who were involved in the Pop-Up were all Hive NYC Super Users! We need to surface and nurture more stories like these:

Ben learned about the event because he follows our various communication channels. Ben is a member of Rev—’s Pop Squad, and came with us to help Hive NYC be awesome at MozFest 2012. He jumped right in to help me facilitate Popcorn Maker mentoring at the Pop-Up. He even wrote about his experiences that day on the Maker Space blog.

Valeria, a long time NYSCI Explainer (I met her for the first time when she was 12 and was in our NYSCI podcasting after-school program) and lives in the local Corona, Queens community NYSCI sits. She was also on the first Hive NYC youth council which gave Hive our name (now a global brand), and on the planning committee for the third Emoti-Con Festival.

Sharon has participated in Hive NYC organization programs at Girls Write Now, Eyebeam, and Global Kids while also being on two youth councils, volunteered for Hive at Maker Faire, was our first Huffington Post Teen blogger and has done other youth reporting assignments for Hive NYC. She is now a Freshman at Columbia University and works at NYSCI on their awesome Explainer TV program.

Valeria, Ben and Sharon, Hive NYC Super Users!

Valeria, Ben and Sharon, Hive NYC Super Users!

The event was Connected Learning in action. The various activity stations were all programmed with themes that interest teens: hacking, music, games, making, viral videos, animation and all without a predetermined “path” or dictated way to choose which experiences to do. Some floated and then settled, some made a point of experiencing each station, and some like Philip, stayed at one station deep diving on “popping” an upcoming video game release video for almost four hours using Popcorn Maker.

Philip is popping some corn!

Philip is popping some corn!

There was hang-out spaces that were comfortable and inviting. There was pizza, drinks and music. It was fun. Socializing ruled the afternoon, friends and siblings came together, new relationships were built (“I am in Manhattan but can use the subway, can we exchange Facebook pages so we can hangout?”) and it was truly a party.

The room was stocked with multi-generational adults from college-age mentors to informal educators to teachers and parents. Some of these were helping to run the Pop-Up and some were participants. I talked and interacted with public school teachers, parent volunteers, researchers, after-school community leaders, informal educators, makers and young adult mentors. It was the most visceral example of the Connected Learning Principles and the Mozilla Mentor Community that I have experienced recently.

This slideshow requires JavaScript.

So let me wind this up by saying that I am sure all of us experience confusion and doubt as we embark on this work. Are we making a difference? Are we talking and championing the right ideas and strategies? How do we stop talking about it and start doing it? By Friday afternoon I was sort of in a mini-existential crisis mode about all of this (aren’t we all by Friday at 6:15 PM?) and the NYSCI Learning Lab Pop-Up was just the bucket of cold water my soul needed to pick myself up and get back into the fight. So thank you Learning Labs Pop-Up for my late Valentine gift!

Networked Innovation and Hive NYC: Pop-Ups as Particle Accelerators

This is re-posted from Rafi Santo’s blog. This post, an excerpt from a longer piece, summarizes themes and cases from early fieldwork he conducted on the Hive NYC Learning Network. If you’re interested in reading more, you can download the full pre-publication draft of this research: Both R&D and Retail: Hive NYC as Infrastructure for Learning Innovation

Starting back in March 2012, I began ethnographic fieldwork looking at the Hive NYC Learning Network, a group of New York City-based informal educational organizations. The network, now with forty members, includes everything from large cultural institutions like the New York Public Library and the Museum of Modern Art to small community-based outfits like The Point or City Lore. The common thread is that all of the organizations are interested in figuring out what learning can look like in the tech-enabled, openly networked 21st century, and how, through coordinated activity, youths’ learning experiences might include more opportunities to pursue their interests.

The network is interesting to me for a lot of reasons, but the one aspect that immediately grabbed my attention concerns what happens when all of these organizations start to interact. Do they share ideas? Do practices spread from one organization to another? Does the network operate as a sort of lab, where new ideas and technologies are born? How do ideas from the broader Digital Media and Learning field (from which the Hive NYC network emerged) get taken up, appropriated, and remixed in the network? Basically, I’m interested in questions relating to innovation – how ideas, practices and technologies that are perceived as new in a given context (Rogers, 1983) get ideated, iterated, and circulated within what I see as a dynamic network of organizations.

In this post I want to share both a case of how I saw the network operating as what I call an infrastructure for innovation and why I think focusing on questions relating to innovation processes is important. Mark Surman of Mozilla put it beautifully when I spoke to him about his aspirations for Hive NYC – he hoped the network could operate as “both R&D and retail”, a place where innovations can both be developed and spread. In keeping with the ethnographic tradition of giving primacy to the perspectives of those invested in the context under study, I used Mark’s words in the title of the longer paper.

Hack Jams & Pop Ups  - “Particle Accelerators” of Innovation 

One of the events I had the opportunity to check out over the summer of 2012 was called the “Hive NYC Summer Code Party” – one of a genre of events that have variably been called Hack Jams, Pop-Ups and Learning Parties (for simplicity’s sake, I’ll just refer to them as Pop-Ups). I give a more blow by blow description of the event in the paper, but I’ll just focus here on the basics of Pop-Ups and how I think they’re significant as regular parts of the Hive NYC’s innovation infrastructure.

Pop-Ups are one or multiday public educational events where different Hive NYC member organizations set up stations and run activities over the course of a day (see map). Chris Lawrence, the director of Hive NYC, described them as “free-flowing, interest-driven festivals where people and organizations highlight and share their tools, projects and ideas, with a diverse audience.” Participants run from families to groups of teens to educational professionals to Hive NYC members themselves. In general, Pop-Ups are less workshop (structured events where everyone does the same thing for the same amount of time) and more festival (casual events where the experience of each person will differ based on how they decide to spend their time). At the Summer Code Party, for example, there was a station where you could engage in self led game design activities, one where you could take existing videos and remix them by adding in annotations and live web content like maps and twitter streams, and a station where you could learn to set up and customize a blog, to name a few.

Screen shot 2013-01-26 at 7.35.58 PM

One of the reasons I focus on these events is that I, and network members, see them as characterized by various ideas and practices around learning that are central to the Hive. Barry Joseph, my old boss at Global Kids (now at the Museum of Natural History) once referred to Pop-ups as “a distillation of the Hive”. He said further “When I think of a distillation of the Hive, and pop-ups, I think about particle accelerators, in which interesting things slam together at fast speeds, for a VERY VERY short amount of time, release lots of energy and new particles.” This sort of particle accelerator analogy speaks to the ways these events have a creative energy that supports innovations to develop, spread and change, and this is very much what I saw at the Code Party.

This idea of “Pop-Up as distillation of Hive” could be looked at in a couple of ways. From the perspective of youth experience, the ideas and practices Pop-ups characterize include production-centered pedagogies, interest-driven learning, multi-generational engagement, youth leadership, public sharing of personal creations, and use of technologies to create engaging and authentic learning experiences. From the perspective of Hive NYC members, these events model both the kind of youth pedagogies I just mentioned as well as how organizations should engage as members of the Hive – these events help put into focus the collaborative, participatory, and, notably, experimental spirit of Hive NYC as a professional network. Pop-up events are opportunities for participating members to bring experimental pedagogies and technologies to the table in a collaborative effort to serve youth.

As part of an innovation infrastructure, these events serve at least two important functions. The first concerns how members use these events to develop and spread their own learning innovations, and the second has to do with the ways the events serve to circulate innovation to network members, in the forms of norms around pedagogical practices and what it means to participate in the network from a professional standpoint.

A Test bed for learning innovation

One of the key infrastructural functions of Pop-ups is to serve as a space where organizations can develop, test, and refine innovations, in this case, both early stage digital learning tools and new learning activities. At the Summer Code Party event, Jess Klein, a friend and colleague at Mozilla, was running a station where kids were playing with the beta-version of a new tool called Thimble that teaches HTML and webmaking. This was pretty representative of the way that the Mozilla software team has engaged with these events – youth have opportunities to learn with emerging tools, and the software development teams have opportunities to see how well their pedagogical software and approaches are working and use that as the basis of an iterative design process. Another member organization, The Institute of Play, was similarly testing a series of game design activities called Gamekit (just released publicly last week in beta form) and was also paradigmatic of how member organizations use these events as places to refine their tools and practices, often running “mini” versions of approaches that are either used within the context of more extended educational projects such as camps or afterschool programs or are part of broader public initiatives.

Spreading Hive NYC ideas and practices

A less obvious way that Pop-ups serve to circulate innovations is by creating a context in which member organizations themselves, along with other interested parties, learn what it is that the Hive NYC network “is about” in terms of valued norms and practices. Anthropologically-oriented learning scientists might characterize network as a community of practice (Lave & Wenger, 1991), with a shared set of evolving ideas and activities that are central to the community, and with modes of engaging “newcomers” through interaction with “oldtimers” in order to expose them to these ideas and practices. Popups act as a conduit for spreading certain ideas and practices central to Hive NYC, be they pedagogical (e.g., interest-driven learning) or professional (e.g., experimentation and collaboration).

I observed that many network members at the Summer Code Party were simply there “soaking it in”, or engaging in “legitimate peripheral participation”, as Lave and Wenger (1991) would call it. Leah Gilliam, one of the facilitators of Hive NYC, shared with me that she saw these events and the experience of participating in producing them as key moments when new members of Hive NYC “get it” – that is, when core ideas of both the ethos and practices of the Hive NYC network are made transparent through participation for network members. The medium of the event is the message to members about what it means to do Hive-like work.

In some cases, these events act as very concrete opportunities for members to develop capacity around and adopting technologies that embody certain values central to Hive NYC. For example, one consistent form of valued practice that I observed in the Hive NYC was that of promoting youth voice in public, and often online, contexts. During the code party, an employee from member organization The Point used resources from a station run by Tumblr employees to build a youth blog for her organization, expanding her repertoire of ways to use new media to promote public youth voice in an openly networked fashion. Other cases were more abstract, with Hive members simply observing, coming to understand some of the ethos and practices valued in the network. In these ways, pop-ups and their ilk act as contexts for circulation and spread of innovations to and from network members.

An Infrastructure for Learning Innovation

I share this case (and the others in the paper) not to claim that Hive NYC is definitively an infrastructure for innovation, but rather that it has the capacity to operate as one. More broadly though, I hope that talking about it can help to spark a larger conversation about the importance of innovation infrastructures in education.

The notion that the Hive NYC Learning Network could be a test-bed of innovations, ones that might be circulated both within the network itself as well as within the broader field of Digital Media and Learning, is one that goes back to some of the earliest conversations in the network. But to me the promise of an infrastructure for learning innovations is something that goes beyond the network itself, one with major implications for how we think about the endeavor of designing learning as a society.

The field of education tends to take a “silver bullet” approach to the process of advancing its work. Various camps stake out particular visions of how to solve the “problem” of education, pushing their often ideological ball forward and aiming to convince all others that, if only we fully put their vision of reform fully into place, all would be well in the (educational) world. Look around a little and you’ll see these everywhere. Vouchers. Educational Technology. Charter Schools. Universal standards. 21st Century Skills. Each is often touted by their proponents as “the” solution.  The education historian Diane Ravitch calls this the “Big Idea”, and notes that none of these sorts of grand plans have ever left education particularly better off.

In contrast to such silver bullet approaches to educational reform, the notion of infrastructures for learning innovation implies that changing our educational practices will (and should) be an ongoing process – one informed by shifts in youth interests, changes in community needs, breakthroughs in our understandings of learning, and identification of new literacies essential for an information age. An infrastructure for learning innovation provides the support to create (or tweak) new ideas and solutions, a way to field test, and a way to show them off others in case they’d like to take them up and use them in their pedagogical practice, and, crucially, allow innovations to be tested in real life contexts as opposed to sequestered laboratories with controlled conditions we don’t find in the wild.

It’s not that the “silver bullets” that I mention above aren’t useful at all; the problem is that we think the solution to education will come in the form of one “silver bullet.” We need many silver bullets for the myriad of issues out there, and a way to understand these innovations not as static entities that either work or don’t work, but as ones that must be tested, adapted and recontextualized based on circumstance.

Infrastructural support for innovation has been a longstanding feature in Science, Technology, Engineering and Math (STEM) fields, with institutions like Xerox PARC and Bell Labs seeding new ideas and technologies that are now regular features of daily life. Indeed, much of the criticism of the education system in the US centers on how little pedagogical practice has evolved over the last century, and this is partly due to the fact that there is little infrastructure that assumes new modes of learning will need to be developed beyond what can currently be envisioned. In looking to understand Hive NYC’s capacity as an infrastructure for learning innovation, I’m interested in seeing if it might contribute to a broader conversation I think we should be having about a vision of education work that assumes that any given approach will eventually become outdated. Perhaps education needs to embrace something the Buddha realized over 2,500 years ago – things are impermanent, and we should live accordingly.