start	end	text
32660	36900	What can we say to convince you to take all of the boundaries down?
36900	40400	To stop limiting what you believe can be yours?
40520	46160	If there is anything we wish to achieve, it is to have each of your boundaries in free.
46200	51440	Knowing that every thought you entertain somehow determines your experience.
53940	58620	Give to believe that you are always at the right place at the right time.
63980	68140	Liberating consciousness into a new way of perceiving.
74660	80120	Frequency is what you know. Frequency is your identity.
91840	96460	Frequency is what you know. Frequency is your identity.
112820	122570	Begin to believe that you are always at the right place at the right time.
139550	145130	If you ask us how much time you need to devote to this, we will say it is very simple.
145130	146730	All of your time.
165640	170000	The right place, the right time, the right place.
203340	208260	Frequency is what you know. Frequency is your identity.
213760	218860	Frequency is what you know. Frequency is your identity.
218980	224320	Frequency is what you know. Frequency is your identity.
224320	228920	What can we say to convince you to take all of the boundaries down?
228920	232400	To stop limiting what you believe can be yours?
232660	238180	If there is anything we wish to achieve, it is to have each of your boundaries in free.
238180	243440	Knowing that every thought you entertain somehow determines your experience.
369250	377150	And to honor their memory in this next year, before we all meet again in, hopefully, Las Vegas next year.
377150	379290	Then we will kick things off.
389520	393020	All right. Great. Let's get going.
393040	394740	Let's go to the next slide now.
396280	400300	This was quite a journey, an adventure for us.
401060	406800	To build such a phenomenal experience in three months, three and a half months.
406800	409700	And we agonized over the decision for a long time.
409760	415300	Should we cancel? Can we cancel? Can we get out of contracts? So on and so forth.
415300	417740	Is there a platform that could support us?
418720	423360	There's a lot of platforms that could support us at maybe 5,000, 10,000 people.
423360	427620	But if we turned out to be 100,000 people, that's a completely different ballgame.
427620	433300	And we didn't know. So we made all of our decisions based on sort of the worst case scenario.
435240	438120	Now, somebody sent me a message.
438840	443640	They were in a chat last night, and beers were being had, and it was getting late.
443640	451660	And Kentaro, if you know El Kentaro, fantastic guy, really embodies a lot of the hacker spirit.
452000	457200	People were lamenting that the con was coming to an end, and that sucked.
457300	462560	Because it was turning out to be so much more fulfilling than what they thought.
462560	466460	They thought it was going to be like a Zoom experience, and instead they get real connection.
466460	473560	And Kentaro told this great story, and I'm going to second-hand it, but here it goes.
473560	479700	He said, there's a concept in Japan, in Japanese, called Ichigo-Ichi-I.
480000	485180	And it describes a cultural concept of treasuring the unrepeatable nature of a moment.
485560	491420	The term reminds people to cherish any gathering that they may take part in,
491420	494960	citing the fact that at any moment, life cannot be repeated.
494960	499680	Even when the same group of people get together in the same place again,
499880	506640	a particular gathering will never be replicated, and thus each moment is always a once-in-a-lifetime experience.
507360	512660	And I really feel that we've just gone through a once-in-a-lifetime experience.
513000	518200	We thought one thing, and a different thing happened. And it's amazing.
518420	522860	So we want to give you a little bit behind the stories of what it took to pull this off,
522860	527560	get some inside scoop from the people running the different departments making it happen.
528600	531540	And I do want to do a quick – let's go to the next slide.
531540	537780	I do want to do a shout-out, though, to everybody who helped financially make this possible.
538360	544040	So you may not have realized it, but every time you bought a shirt or a hat or a badge –
544680	552220	let's go to the next slide, too – even this pin, which is a fantastic pin,
552220	559520	what you were really doing is helping keep DEF CON afloat and ensuring that we're going to be in Vegas next year.
559720	563740	So I felt really strongly that I wanted this experience to be free.
563740	569920	I wanted to let everybody experience it from all over the world that normally can't get on an airplane.
570640	578280	But we have bills, too. And so by you purchasing some of our swag, you really made it possible.
578280	582860	So thank you for that. You can wear it proudly knowing that you really made this possible.
583180	584440	Let's go to the next slide.
586600	590740	Same thing for the badge. The badge – we wanted to make this badge,
590740	595940	and we wanted to tie a badge purchase to a human plus on the Discord system,
595940	598000	and we just couldn't figure it out in time.
598000	602500	There was no way to take, like, a PayPal transaction and tie it to an eBay auction
602500	608580	and then tie it to a UUID on Discord for people who hadn't even created Discord accounts yet.
608980	614560	So instead, they ended up doing two different things, the on-site human plus and the badge.
614760	617060	And let's go to the next slide.
619760	623700	Just like trying to make the experience free for everybody,
623700	626600	we tried to make the badge experience, the badge puzzle, free.
626600	632480	So everybody who's got a physical badge has everything they need to play the badge contest.
632480	635780	But if you don't have one, that's okay.
635780	641200	Everything is free and downloadable on the media.defcon.org server, and you can keep playing.
641200	644860	And the primary place to play is on the DEF CON forums.
644860	647480	Lost goes there and helps people out.
647580	651480	So we tried to really maintain that same experience.
651920	653780	And let's go to the next.
653780	658380	And if you see, we started to collect some of the slides that people were putting in,
658380	662100	some of the Twitter posts or Instagram posts or Facebook.
662480	666900	And you can see people all over the world getting in on the DEF CON spirit.
666900	668580	Even Matt Damon is in on it.
669300	670680	Go to the next one.
672180	677320	And you can see a map here of where there's people across the United States.
677320	682840	And later you're going to see in Riverside slides where people all over the world hitting our Discord.
684400	685840	Next slide.
686860	689040	Oh, you're at the right one. You're at the right one.
689140	690500	DEF CON safe mode.
691480	695800	So to make this happen, to get us all together in one place on Discord,
695800	699440	we went through this crazy selection process on the forums
699440	702060	where everybody was debating which platform to use.
702060	704680	And in the end, Discord pretty much won out.
704680	709600	And Riverside is going to talk a little bit about what the features were that really sold us on it.
710840	713860	It was down to Riot pretty much for this.
714040	719340	Except Riot, we weren't going to be building servers and optimizing SQL queries,
719340	721280	and we just didn't have time.
721340	725020	Especially if you're building a server for 5,000 people or 100,000,
725020	726720	it's a completely different thing.
727040	730320	So with that, I'm going to pass the mic over to Riverside,
730320	735000	head of the DevOps team that really made the magic behind the scenes and pulled this all off.
735000	737140	He's going to talk through some of the experience.
737620	738980	Take it away!
739700	741640	Thanks, DT. Hey, everyone.
742260	746540	I don't know about you, but I definitely felt the DEF CON presence.
746620	750920	Finally, virtually, normally when I'm sitting on different video calls all day,
750920	754100	I don't feel like I'm connected the way that I did with this platform.
754100	755320	It was pretty fantastic.
755320	758320	And it took literally an army to make this happen.
758320	764420	And this was the first time that I've been on a team of cross-platform,
764420	772460	cross-team members across the whole DEF CON since the very, very early days of DEF CON.
772480	778440	We took a list of every goon that was out there and all the different skills that they had,
778440	780860	and we didn't look at the names, we just looked at the skills.
780860	784420	And we boiled it down like, okay, these are the individuals that have that skill,
784420	785780	and then we tapped them on the shoulder.
785780	790640	And we got people from so many different departments to make up that DevOps team,
790640	792920	and they absolutely knocked it out of the park.
792920	793900	They were fantastic.
793900	796480	Most of them were up 24 hours a day.
796540	802640	We spent countless hours working on these different things, and I'll get into all of that.
802640	807760	And then, of course, the individuals from the Packadacking Village and the Wall of Sheep team,
807760	810660	which is one of the villages that I run,
810660	815900	spent a whole lot of time building documentation, videos, process, procedures,
815900	818800	and testing for the proof of concept for DEF CON.
818940	824740	And then every time we would go, we would get an idea fairy floating around going,
824740	826860	oh, we should do this. Can we do this?
827100	829740	They were the test subjects of all of this,
829740	833920	and they went through a tremendous amount of pain going through all of that for everyone.
834180	836860	So they definitely need an additional shout out.
836860	839720	And the people that are on that list, I'm sure I missed somebody.
839720	840900	If I did, I apologize.
840900	845940	But those people specifically contributed their time for the better overall DEF CON.
845940	850040	They actually worked on server equipment, documentation that was shared across villages
850040	853280	and contests and areas and just busted their butt.
853280	857580	And then the Discord team, who we had names there originally,
857580	861100	but we're just kind of blurping that out for their safety.
861100	863380	They've asked to kind of just stay anonymous-ish.
863380	867160	So we censored that, but they really supported this.
867160	870700	It was an amazing experience to work with Discord proper.
870700	875480	And DT had mentioned the Riot Matrix slash Discord.
875840	879020	And the reality is that with the amount of time that we had,
879020	886460	we would have needed to put together a huge operation beyond just the platform,
886460	889380	but building out the entire platform for ourselves as well,
889380	893280	making sure there was failover redundancy, getting all the things in place.
893280	898680	And we didn't have the capability to do all the bots and all the components.
898680	904060	We had a tremendous Discord community out there that had already built bots
904060	906800	that were willing to pitch in and help out.
906800	911460	We had a whole bunch of people sharing constantly, as our community normally does.
911560	915260	It was just great. And then we had a whole lot of other people bump in.
915860	919540	Show them the next slide.
919720	921100	Yeah, next slide, please.
921980	927620	Right here we have a really cool demographics slide.
927760	932800	We had about, well, it's close to 50-50, but 60-40 right there.
932800	935320	60% US and 40% other.
935320	938820	And while some of those might be VPN, we don't necessarily know that.
938820	940000	That is the demographic.
940000	943180	And based on the experience and the conversations that I had over Khan,
943180	945080	it truly was an international conference.
945080	946780	We had people from everywhere.
946940	947880	And this was really cool.
947880	951260	We could kind of get a mix of what platforms they were using
951660	956380	and how long they'd been members of Discord and whether they were new or not.
956380	958280	And there were a lot of people that were very new.
958280	962220	So we had to go through a lot to train them and get them together and get people on.
962220	963220	Next slide, please.
965560	968980	So it took weeks and weeks and weeks of daily stand-ups.
968980	972280	At 5 o'clock every day, this team was on a call, going through blockers,
972280	973500	trying to design things.
973500	977180	We were really flying a plane and upgrading it at the same time.
977180	979340	It was kind of crazy, but it was amazing.
979760	984220	We built processes to take in every request from every department
984220	987880	into a Kanban board and ran this like a hardcore project,
987880	989440	as silly as it sounds.
989440	992360	And many of the hackers in the community are like,
992360	995100	ah, process, ah, Six Sigma, whatever.
995100	999600	We did end up using legit processes to try to figure out getting this together
999600	1000640	because it was so chaotic.
1000640	1006600	We're basically, with Grifter's competitions and Zant's villages,
1006600	1010200	it's like 60-plus little mini-conferences inside of the conference,
1010200	1013700	trying to get all the requests from everybody to serve them properly.
1013700	1015480	So it was pretty insane.
1015480	1016700	We had some cool things.
1016700	1020780	We had over 200 issues closed, lots of emojis all over the place.
1020780	1026140	We did build a business continuity plan with all sorts of crazy attack scenarios.
1026140	1028600	We had no idea what to expect.
1028600	1031060	We were thinking like end-of-the-world attacks.
1031360	1034640	Yeah, our bots had backups to their backups to their backups.
1034640	1036900	We had stuff hosted all over the place.
1037160	1038560	It was pretty cool.
1038560	1042920	Development of guides, videos, training.
1042920	1044080	Next slide, please.
1044080	1045600	I'll go a little bit into the bots.
1045600	1050280	So we had stuff hosted in the World Domination headquarters for DEF CON.
1050280	1053440	We had Discord proper hosting things.
1053440	1054820	We had stuff in AWS.
1054820	1056460	I mean, it was everywhere.
1056460	1064260	We didn't put the shard slide up there, but there were clusters of 700 different things running simultaneously.
1064260	1065680	And if one went down, another went up.
1065680	1071320	And we were really trying to be as highly available as we possibly could to keep this experience clean and smooth.
1071320	1074140	We had 28 bots that were separate.
1074140	1076220	Most of those were hand-coded.
1076480	1080060	We had some major ones that were running.
1080060	1084520	And then inside of those major bots, we had to write sub-programs, like little micro-bots.
1084520	1087660	We had 167 custom micro-bots.
1087660	1090500	And then, of course, lots of Easter eggs that we put in to have fun.
1090500	1093880	And, of course, the SOC staff and QM and all the different departments were like,
1093880	1097360	hey, can you make a command that will do this or pop a picture of this or whatever?
1097360	1103980	But in the end, it was 14,195 lines of code in the repository.
1103980	1104900	It was crazy.
1105700	1111380	We also had some individuals that shared some zero-day drops, and that was kind of cool.
1111380	1112940	So we're like, oh, look, zero-day.
1112940	1118400	Why don't we just share this with the whole world on VirusTotal and see if they keep doing that?
1118400	1123880	And as soon as they realized it was getting shared to VirusTotal, they're like, I'm not going to waste my O-days on VirusTotal shares.
1123900	1125220	And so it went away.
1125220	1129980	It was kind of cool, actually, just them changing their mind on that.
1130020	1136180	We had 189 very special files that VirusTotal was like, eh, I don't think that's malware.
1136240	1139260	But if you look at it, it kind of looks like malware.
1139260	1143720	And Discord did a hell of a job in general on the anti-malware.
1145540	1146760	Next slide, please.
1146760	1154200	So here are a couple of the little cheat sheets and secret commands that were run.
1154300	1161540	We had Discord.exe, which would drop a ridiculous error message that we threw out just for fun in the middle of the night.
1161540	1166000	You can see that one was run at, what, 2.54 or something like that, or no, 2.24 a.m.
1166000	1171020	The Discord error missing channel segment faults in Discord.exe.
1171100	1172320	Cannot find LineCon.
1172320	1175040	That was when DT changed LineCon's name.
1175060	1176500	And we're like, OK, what happened?
1176500	1177320	And then we looked into it.
1177320	1178800	We're like, OK, DT changed it.
1178800	1180800	We just started playing around with DT.
1180800	1181760	It was great.
1181960	1187620	And then, of course, CJ's team had to throw a little smack at CJ and have fun with him.
1187620	1188700	That was great.
1188820	1190380	That was super fun.
1190380	1200380	And then we had a bot that would immediately ask QM for stanchions at pool two, and they'd throw that out, and all of a sudden they were asked for stanchions at pool two and make a hole.
1200380	1201160	And there were a bunch of others.
1201160	1203100	That's just an example of some of the funny ones.
1203100	1204400	Next slide, please.
1206640	1209720	So prior to going live, we built a PRPL team.
1209720	1214760	We had a whole bunch of people from both the offensive and the defensive side come together.
1214760	1225360	We built a test server, and we grabbed every single script kitty, open source, you name it, raid bot, attack component on Discord.
1225360	1226820	We worked with Discord proper.
1226820	1229280	We're like, OK, what are the things that are going to be a problem?
1229300	1230460	What can we use?
1230460	1231500	What do you see?
1231540	1234300	And then we kicked the hell out of that thing.
1234300	1239140	And every time we would beat it up, we'd look at the blue team, and we're like, all right, how about now?
1239140	1243240	And then they'd tweak the security a little bit more, and the red team would go and attack it a little bit more.
1243240	1244440	And we're like, how about now?
1244440	1252060	Until it got to what it is, and we actually had a pretty darn good system in the end.
1252060	1254240	And I was really happy with the way that it ended.
1254680	1256380	Explain this slide.
1256760	1261020	Yeah, so what you're looking at right there is an ASCII character bomb.
1261020	1267820	And you just throw a maddening amount of ASCII characters into a channel over and over and over.
1267820	1274080	And it will actually freeze the channel if you don't have proper bots and can cause an insane amount of problems.
1274080	1280600	You can also have individuals randomly changing their name and their icons, doing icon bombs.
1280600	1283780	There were probably 40 or 50 different styles of attacks.
1283780	1286200	We hit the majority of them.
1286200	1289920	And the way that we did that is through a huge amount of different bots.
1289920	1292540	So we had, of course, the Yagbot.
1292540	1294000	We had the Dinobot.
1294000	1295600	We had all the custom bots.
1295600	1306000	We had the Wall of Sheep bot in there, which was kind of hysterical watching all the people do PII leaks of what they were playing and what they were doing at any one given time on the server.
1306000	1307220	That was hysterical.
1307260	1313480	So you could see people playing World of Warcraft for an hour or two here, and they didn't turn the setting off in their Discord.
1313600	1315680	So it was saying, I'm playing World of Warcraft.
1315680	1320420	And so we were just passively watching everybody do all that and watching the graph.
1320420	1323200	And we have the graph of what our community likes to play.
1323200	1327820	And you can actually go into the Wall of Sheep channel and go, Wasp, what did I leak?
1327820	1329640	And it'll tell you if you leaked anything.
1329640	1330620	It was pretty funny.
1330980	1333420	So that was the purple team.
1333420	1337100	We had a whole bunch of other stuff, and it was pretty great.
1337880	1338340	Thanks.
1338340	1340600	And you guys are now going to, what, sleep for a week?
1341180	1342880	I think two weeks, actually.
1342880	1345320	I think two weeks sounds about right.
1347740	1348940	Thanks, Riverside.
1348940	1355300	And thanks, everybody on the DevOps team, because it was impossible without everybody's help.
1356320	1371160	Next up, I would like to introduce the speaker team leader, PWKraft, who's also going to represent a little bit of the demo lab, because we could only get so many faces here on the board.
1371320	1378060	And we had to completely change the way that speaker operations work this year, and he's going to talk you through some of that excitement.
1378060	1379540	So take it away.
1380100	1380980	Thanks, DT.
1380980	1388020	For speaker operations this year, it was all about using the platform to drive community engagement.
1388540	1395460	DT made a decision early to drop all of the main stage talks on YouTube and the media server at the beginning of the con.
1395520	1400140	This made the talks easily accessible to all attendees at their convenience.
1400840	1406920	We did a time shift reviewing, and that enabled you to take part in other elements of the con.
1406920	1413980	DevCon main stage talks received more views on YouTube than they would typically have received in tracks in Vegas.
1414220	1423720	They averaged about 3,700 views, and the most popular talk was a talk about hacking traffic lights, with 9,700 views over the last three days.
1423860	1429820	We've also held live Q&A sessions with all the speakers, taking questions, and hosted free fireside lounges.
1429820	1433540	This allowed more people to engage directly with the speakers.
1433540	1441800	Speaker operations has also been gathering all the content across the entire con, including demo labs and village presentations,
1441800	1446900	and we'll be making everything available for download for free from the media server.
1446920	1456380	So there's a bunch of statistics about sort of the number of live stream views we had and minutes viewed, interviews, and that type of thing.
1456380	1464360	And the next slide that is about the demo labs... lost that.
1464360	1468320	But anyway, the next slide is about some of the demo lab statistics as well.
1468400	1477680	Those were available, and those demo lab presenters, again, were also engaging with the people who stopped by to view those demos.
1477980	1480160	Thanks a lot. Back to you, DT.
1482940	1484360	Let me unmute.
1485820	1494820	Yeah, so we made some decisions early on, and it was funny because the decisions were really predicated on we're going to be under attack,
1494820	1497020	and there's no guarantee we're going to be up.
1497020	1503400	So why don't we take all these videos and release them as soon as we can on YouTube and on BitTorrent?
1503420	1508020	So worst case scenario, you've got all the badge files, and you can play that game.
1508020	1510580	You've got all the videos. You can watch all the videos.
1510580	1514400	So if DEF CON is on fire, you could at least have a beer and watch the videos.
1514800	1519100	The worst case scenario is you could still watch the talks.
1520000	1524140	And instead, it really enabled people to time shift a lot.
1524140	1531880	You could watch the DEF CON talks whenever you wanted, and then that would allow you to make room for some of the other villages or contests and events that couldn't time shift.
1531880	1537960	So I think it really allowed people to experience CON in a way that we didn't really even conceive of.
1537960	1544920	For us, originally, it was a defensive move, and instead, it ended up being like a multiplier for people's experience.
1545160	1554460	So like a lot of things in DEF CON, I'd love to be able to take credit for it, but honestly, it's a happy side effect of what happened.
1556260	1562980	So we have a slide in here, but unfortunately, Wednesday, our press wrangler can't fit on the screen.
1563120	1569540	But we had dozens of new DEF CON journalists. Let's jump over to that slide.
1570480	1578620	As you know, normally, every year, we have tons and tons of press, and a lot of them sometimes don't respect our rules, and it always leads to drama.
1578620	1587040	But this year, everything was remote, therefore, we couldn't have any of that kind of drama. No camera crews crowding hallways and blocking people.
1587040	1588820	So that was great. They were very happy.
1589360	1597640	And it was interesting, too, because all the original stories that were slated to come out, or some of them came out, were all about the super scary moderation,
1597640	1605400	and how DEF CON is going to be overtaken by trolls, and it's going to be just like Gamergate. It's just going to be terrible.
1605400	1610280	And how is DEF CON going to handle it? And what are our things? And how have people been trained?
1610920	1618740	They wanted to know everything. And since we've never done one of these before, we were inventing everything for the first time.
1618740	1623220	So we were trying to follow best practices, but we didn't know what was going to happen.
1623380	1627360	As soon as everything started going well, all those stories dried up.
1627360	1633480	And so now I'm really curious what the press spin is going to be. Is it going to be on the content, the human experience?
1633480	1641440	But it's not going to be about the crazy bots anymore, and the trolls, which will be great. I'm really curious to see what the human interest side of this all is.
1642080	1643340	Okay, let's go to the next one.
1644180	1651120	For this next one, I'd like to introduce CJ, a man who needs no introduction, and his accent is fantastic.
1652160	1659960	He leads the SOC team and was primarily responsible for developing moderation and deploying goons.
1659960	1663900	It would normally be saying, make a hole and dealing with people in person.
1663900	1669000	They're now dealing with people at arm's length and issuing warnings and bans and kicks.
1669540	1676280	And it's his duty to report into us what happened with transparency and how things went.
1676280	1677560	Let's hear from Mark.
1677560	1683800	Thanks, DT. So, I have to admit, I had no idea what to expect either.
1683800	1686780	This was a completely new experience.
1687360	1697900	I'm used to things like corridors full of people, random police officers appearing, special agents from different parts of different governments dropping in on us.
1697920	1699840	And, of course, none of that happened.
1699840	1705200	But day one, we had someone pass us some files that said, hey, we've got a no-day.
1705200	1708320	And then basically tried to plan us with a keylogger.
1708520	1715320	Like, okay, you know, we're a hacker conference, and my team is mostly security researchers.
1715320	1717600	So, A, thanks for the gift. That was cool.
1717820	1720040	And B, what were you expecting to happen?
1722300	1723180	Transparency-wise...
1723180	1727200	You were so polite, too. You even gave them some time to explain themselves.
1727200	1731900	I mean, like, I was curious. Like, I don't know what their endgame was.
1734780	1739560	So, I don't have a full transparency report for you this moment.
1739960	1743180	It's like all these things, it's a little bit more complicated.
1743180	1750380	Because one of the things that we actually decided to do this year was put the power of moderation into the hands of more of the community.
1750640	1754880	And so we allowed pretty much every goon to have some kind of moderation capability.
1754880	1761060	And we allowed the villages and the contest areas to have moderation over their own spaces.
1761060	1764080	Because at the end of the day, who knows their spaces better than them?
1764420	1766400	And I think it really worked out well.
1766400	1772640	But it now means I'm going to have to run around like crazy looking at logs all over the place to try and pull up the stats of what happened.
1772640	1775560	So, we'll get that up to you in the next couple of days.
1775560	1779920	But broadly, I would say this was the chillest DEF CON I've ever been in.
1779920	1782600	And I've been coming to DEF CON for way too long.
1784040	1788840	I think we only banned probably between two or three people.
1788840	1790920	Like, as you properly had to ban.
1791820	1795840	We had to mute a few people because they were saying inappropriate things.
1795840	1798780	But, you know, steps were taken pretty swiftly.
1798780	1802800	And most people got the hint after the first sort of, hey, don't do that.
1803040	1804760	And chilled out.
1804760	1814220	And so, you know, given the number of people we had, the percentage of folks that we actually had to deal with aggressively is almost negligible.
1814220	1816680	And that's awesome because that's community.
1816780	1819860	And it shows that the community can look after itself.
1819860	1823520	And that we can make this whole experience safe for everyone.
1823520	1825480	Which is awesome.
1825960	1831260	I want to give some shout outs to some of the folks who just put themselves out there.
1831260	1835480	Some of my own SOC goons were just amazing in the way they moderated stuff.
1835760	1839700	Fidget Spinner terrified me because she was just, like, non-stop.
1839980	1841580	Glasswalker was awesome.
1841740	1846080	And, obviously, my second Tacitus was just like a rock, as always.
1847040	1853200	And all the rest of my goons, like, all my brothers and sisters in other departments, you guys were amazing.
1853240	1858520	I've never seen a conference put on in such a short amount of time and come off so well.
1858520	1859920	It was awesome.
1861200	1868600	Did you notice, too, like, on Thursday, we were doing our soft open, or our open, and I caught this one person.
1869040	1875500	And they kept testing things, like saying super political things or saying vaguely racist things.
1877720	1879600	And so I challenged them on it.
1879600	1882160	And they said, oh, no, I'm just testing, I'm just testing.
1882220	1886600	And I think what they were trying to do was calibrate how aggressive we were going to be.
1886600	1890140	And once they got a couple of warnings, they disappeared.
1890460	1891940	And that UUID disappeared.
1891940	1895120	So if they came back in again, they had to do it with a completely different account.
1895580	1896400	We saw a bunch of that.
1896400	1904780	There were a bunch of bots that kept connecting and would try different things without verifying and then disappear and then come back and keep trying and keep trying.
1904780	1907180	So I think we were probed quite heavily.
1907340	1909980	And I think people realized it was just not worth the effort.
1913760	1914580	All right.
1914580	1919480	So next up, the information booth.
1919600	1925560	We realized a little too late that there's too many sources of information.
1925660	1927500	There's our information that we're generating.
1927500	1931080	And then there's a lot of community-generated village contest information.
1931200	1934480	And we need a way to corral all that.
1934480	1936780	And traditionally, that's our information booth.
1936880	1943240	This year, they had to take on some additional roles and change the ways in which they displayed all this information.
1943240	1945860	I think they did a fantastic job.
1945920	1951400	Let's move on to introducing Little Bruiser, who runs the info booth.
1951400	1954920	And he can talk about all the different things that they had to do differently this year.
1955100	1956300	Take it away.
1956900	1958220	Thanks, DT.
1958460	1962220	Yeah, info booth was a lot different this year.
1962480	1964960	As you know, we can't see people face-to-face.
1964960	1971220	But one thing that was different this year especially is we never got, where's the restroom?
1971480	1974820	Which is always our number one question every year.
1975000	1983040	So using the HackerTracker team, man, those five folks really pulled it together.
1983040	1989320	Because they push everything out through the HackerTracker app and the info.DEF CON.org.
1989320	1994120	And then this year, we added adding this stuff to DEF CON forums.
1994120	2003300	And then we pushed it over to statically over into the actual DEF CON.org website as well.
2003680	2011300	So things that we may look at future is how to get some of that stuff coordinated a little better.
2012460	2024900	From Friday, we had on info.DEF CON.org, we had 3,200 users in total for HackerTracker and the website.
2024900	2027380	And almost 2,000 were strictly on the website.
2027380	2034360	Because that was the best place to go especially for Discord in order to get the scheduled information.
2034360	2036900	And on Saturday, we had about the same amount of people.
2036900	2043660	We had 3,100 total and another 1.9 strictly on the website.
2043940	2049120	So the main questions that we normally get is, you know, where is this? Where is that?
2049120	2051760	But this year, again, was a little different.
2052000	2061260	The main thing was with the InfoBooth channel, it was pretty much the only one that was wide open when you didn't have any roles assigned.
2061260	2063080	You could come to us and ask questions.
2063080	2073320	The primary thing that we did was helping attendees attain that human role so they could go find the villages and they could go find the contest and do what they wanted to do around Con.
2073480	2079560	And then the second thing that we dealt with was the HumanPlus issue.
2079560	2084020	We would help them attempt to gain HumanPlus.
2084020	2089240	And when that failed, you know, I want to give a great shout out to Seastone because he really stepped up.
2089240	2096040	And when there were issues with us helping users get the HumanPlus badge, we just reached out to him and he took care of it.
2096040	2096880	He was awesome.
2096880	2097740	So thanks, Seastone.
2097740	2100740	Really appreciate all your effort there.
2101040	2108000	And then the third question is really for you, DT, is what's going to happen to the Discord server now that DEF CON is over?
2108620	2112140	We're going to have to wait until the end of the closing ceremony.
2113020	2116220	And that's a fair question because that was what we kept getting.
2116220	2118240	So that was the answers we were given.
2118240	2120600	So that's all I have for info, Bruce.
2120600	2121700	So thanks, DT.
2123160	2124440	Yeah, thanks for doing that.
2124440	2128440	And we'll keep the info.defcon.org running for a while.
2128440	2130860	And you can go back and look at the schedule.
2131460	2132000	Okay.
2132000	2135260	So next up, we've got all the villages.
2135680	2143500	And as it was alluded to earlier by Riverside, running villages is quite complicated because there's so many people.
2143500	2146060	Each one is like their own mini conference.
2146060	2147480	Some have contests.
2147480	2148160	Some don't.
2148160	2150020	Some are just hands-on workshops.
2150260	2152820	And wrangling all that is Vance.
2152840	2154560	So take it away, Vance.
2159780	2160660	Thanks.
2162000	2164160	We ended up having a good number of villages.
2164160	2167000	We ended up at a total of 30 villages this year.
2167680	2171080	Across 30 villages, there was a lot of stuff going on.
2171260	2174400	I think we clocked it out at over 600 total events.
2174400	2179820	I was combining talks, contests, and workshops and everything else that they had going on.
2180300	2184600	And it was crazy because the same thing as everything is with all the timelines we're fighting.
2184600	2186500	It's like, I need this now.
2186500	2191480	And it's like, I can't do it now because half the villages are on the other side of the world.
2191480	2193980	So I can't get you an answer in 10 minutes.
2193980	2195260	I need time.
2195660	2198960	So yeah, other than that, it came together very well.
2198960	2201720	I would agree that this was one of the craziest years we've had.
2201720	2203280	It was smooth and it was fun.
2203280	2205460	We had almost no intruders.
2205460	2207460	Didn't hear from some of the villages at all.
2207460	2208880	So that was a great thing.
2209460	2213580	We would want to go ahead and thank all the village leads and all the village staff.
2213580	2219480	Because it took all of them to pull each of their villages together for us to put this all together and make it happen.
2219700	2222220	We'd also like to thank all the village goons for their help.
2222220	2224440	Because they made my job really easy this year.
2224440	2228820	I actually was able to escape and even play video games a couple times during the con.
2228820	2234460	I also, as has already been done many times, I want to give a big shout out to the DevOps team.
2234620	2237700	Their response time and their support for fixing things.
2237840	2241860	And getting this channel open or a speaker able to talk in this channel.
2241880	2244300	All that stuff was done like almost instantly.
2244300	2245920	So that was perfect.
2246540	2251220	And to wrap it up, I want to thank DT and Nikita and all the other staff.
2251220	2255680	Because my legs and my feet are actually what want to do the thanking.
2255680	2260880	For the first year, this is the first year I don't think I've walked on an average of 12 miles a day.
2261120	2264180	However, my heart seems to disagree with the rest of it.
2264180	2270560	Because it missed the ability to be able to see all my friends and meet everyone in person and meet all the new people that we do every year.
2271060	2273780	Other than that, that's about all I have for villages.
2276680	2277760	Back to you.
2277760	2279060	Hey, thanks.
2281120	2284180	So somebody woke up and is sitting here with me.
2284180	2286040	Hello. Hello.
2286680	2287640	Okay.
2288320	2290140	You're a star for a minute.
2290140	2291560	And I can hide from them.
2292040	2296920	Next up we have another big social component that played an outsized role I think this year.
2296920	2304820	And that was the entertainment, the live DJs, and the streaming of music all the way in the weeks leading up to Cannes.
2304820	2312740	And I think having so much artist creativity really helped bolster our sense of discovery.
2312740	2322420	But also, it was just cool having a drink, talking to people on Discord, with the Twitch stream open, watching DJs, Jackalope, whoever, just tearing it up.
2322420	2327900	So to talk about that whole experience and building it, we've got Chris A.M. from the A&E department.
2327900	2329440	So take it away, Chris.
2329600	2330600	Hey, thanks, DT.
2330600	2332840	This was such an amazing year.
2332840	2336780	Even in safe mode, we were able to come together and produce such a great show.
2337080	2340600	I'd like to start off by thanking the folks on my team who made this all possible.
2340600	2343740	Without them, we'd have nothing but a blank screen and dead air.
2344180	2350720	First, my deputy department head, Chris Klink, who wrangled all the DJ submissions and curated the fantastic lineup that we had.
2351180	2354680	Zekes, who led up our operations and technology component.
2354680	2360780	All the graphics you saw, the smooth transitions, the orchestrated music that kept going 24 hours a day, that was all him.
2361480	2364220	DJ Dead, who produced the official soundtrack.
2364280	2366600	And the rest of the team who helped make this a success.
2366700	2369540	Control, Stitch, Great Scott, Dave's Bass.
2370060	2377720	My team and I would really have nothing to do if not for the time, the talent, and the dedication given by each one of our performers this year.
2377980	2382300	They seamlessly adapted to performing sets online from wherever they resided.
2382660	2390120	And additionally, I'd like to give a special thanks to Riverside and the entire DevOps team for creating and maintaining an awesome experience online.
2390120	2393540	Soma FM for running the entertainment in the Chill Out Lounge.
2393540	2396760	Zevler Studios for helping us with decor and graphics.
2397040	2402040	And all of the open source developers who created and maintained all the tools that we used this year.
2402200	2407640	And finally, a big thank you to the DEF CON senior staff, Dark Tangent, Will, Nikita, Linda.
2407640	2411220	They believed in us and they let us try all these new things this year.
2411380	2414780	I want to talk a little bit about the stats now.
2414780	2416200	So, next slide.
2416200	2421520	We ran two concurrent streams, one for the Chill Out Lounge and one for the main stage shows.
2421620	2427560	For the main stage channel, we had 113 hours and 27 minutes of total broadcast time.
2427560	2431400	This equated to 3.6 million total minutes watched.
2431660	2435440	We had 300 plus viewers consistently for the nighttime shows.
2435440	2441260	And over 1,000 viewers at the peak with a total of 48,950 live views.
2441260	2447360	Our Twitch channel got 2,457 followers and 68 paid subscribers.
2447360	2450040	All of those proceeds are going to the EFF.
2450420	2458540	And for Chill Out, Soma FM averaged about 178 concurrent connections and peaked with 300 on midday Friday.
2458680	2460300	So, what's next?
2460500	2466900	We're not promising anything yet, but we are talking internally about how we can keep the music channels alive all year long.
2466900	2470140	And possibly even do some live events throughout the year.
2470140	2474600	So, please keep an eye out for when the call for music opens for DEF CON 29.
2474940	2478900	We really strive to present the best entertainment experience for all of our attendees.
2479380	2483780	And if the kind of music that you've been hearing really isn't your jam, submit something different.
2483780	2486140	Tell your friends to submit. This is your conference.
2486480	2493120	We're committed to embracing the diversity of our audience and include that in the selections we make for what you hear and see on stage and online.
2493140	2494840	So, we really want your feedback.
2495020	2497720	And thank you very much for everybody. Back to you, BT.
2499640	2503060	Awesome. Yeah, you can imagine. Look at that. 113 hours.
2503200	2510140	Now, I've got to try to track that down and get it on the media server so everybody who missed out on it can watch later or listen later.
2511100	2515660	Hey, next up, we're going to talk about all the concepts and events.
2519030	2520430	All the concepts and events.
2520430	2527670	So, villages are the one half. Concepts and events are the other.
2527670	2531590	And so, this is where you get your problem solving on. You can win prizes.
2531950	2537750	And anyway, I have a little disaster happening here in my hand.
2537750	2542510	So, I'm going to pass it off to Grifter. Take it away, Grifter.
2543890	2545030	Thanks, DT.
2545270	2548590	So, yeah, it was a little bit different this year, obviously, right?
2548590	2554350	Not doing a contest or event in person gave us some interesting challenges to overcome.
2554350	2563310	And when we reached out to all of the different contests and events that we're used to dealing with every year, we weren't sure what the response would be.
2563310	2567790	But it was overwhelmingly positive. They were like, let's try to do this.
2568250	2570610	And so, we loved that.
2570610	2578830	It made it possible for us to try to create as much of the DEF CON feel and vibe that we have when we're all in Vegas together.
2578830	2588730	What was interesting is that some contests even had more participation in this virtual environment than they do in real life.
2588730	2593170	And I think that, one, allows geographically folks to come and participate.
2593170	2600410	But also, it can be a little less intimidating when you're not looking at somebody face-to-face and you're working on puzzles or challenges by yourself.
2601530	2606490	It's a lot easier for introverts to participate.
2606590	2608510	I vibe with that quite a bit.
2608510	2613210	The effort that the organizers put in, though, was incredible.
2614610	2627330	Just to get an idea of how good... if you didn't see what Hacker Jeopardy, or whose slide is it anyway, or what the scavenger hunt dashboards look like, go take a look at those things.
2627330	2630110	Go see what they put together. It was phenomenal.
2631490	2638470	Again, different scenario, but it made a couple of changes happen.
2638470	2644930	This year, I think most people are aware that we made the decision.
2644930	2652990	It's hard to figure out how hard something is if you're not sitting there watching it, or not talking to teams, not talking to organizers, and that kind of thing.
2652990	2658930	And black badges were reserved for the capture the flag, the large capture the flag only.
2658930	2663330	And that was interesting, because we thought, what's that going to do to participants there as well?
2663330	2665030	But people still played, right?
2665030	2669950	So in some cases, there were contests that still had tens of thousands of dollars in prizes and that kind of thing.
2669950	2675290	But there were some where it was just the love of the game, and we still saw people playing all the time.
2675290	2682530	So it's cool to see people play for the love of it and not for some nebulous prize out there, right?
2683350	2688930	Throughout all these contests and all these events, just like we just heard about music and the villages, wherever,
2688930	2695590	we had countless hours of audio and video of people just getting together and working on things together,
2695590	2700670	telling stories, sharing their frustrations, asking for help.
2700670	2708170	And then also just talking about what drove them to participate and what it means to them to be a hacker.
2708170	2711870	We saw them competing in different mediums.
2712370	2717150	Folks who were strictly on Discord. Some things were being run on Discord and Twitch.
2717150	2720290	Other things were also done in virtual reality.
2720390	2726370	And we still had people doing stuff in meet space, even though we were socially distant, right?
2726370	2730590	So it's like, oh, we're going to run 5Ks, and then we're all going to report back how we did.
2730690	2734890	And so there were people participating in these activities all around the world,
2734890	2739170	and then just coming back and saying, like, oh, here's what I did, here's where my stats were, that kind of thing.
2739170	2740170	It was great.
2741270	2746070	And as is normal in these situations, competition is fierce, right?
2746070	2755150	Tempers flare, secrets are being kept, and you have moles being inserted on other teams, those type of scenarios.
2755210	2759790	But in the end, the contests and events are really about a shared experience.
2759790	2768870	It's about strangers becoming friends, enemy becoming friends, and then even friends becoming family, right?
2768870	2772450	So they give us something that distracts us from the real world.
2772450	2779270	They give us something to focus on and expose maybe even something where we don't realize there's a gap in our skill set
2779270	2787710	that we then start to work on and hone to become something and a part of us that we never thought we would ever be able to live without.
2787710	2794450	So if you're not participating in the contests and events at DEF CON, please, please come and join us.
2794450	2801090	There are many, many things that you can do, and just come out and be part of it.
2801090	2802770	You'll have a blast.
2802790	2807150	And to the organizers and everybody who participated, thank you.
2807150	2808670	I know you made my weekend great.
2808670	2810630	I hope we made yours great as well.
2810650	2811770	Back to you, DT.
2813770	2814750	Right on.
2814750	2816090	That was really well said.
2817270	2820310	Okay, I'm now locked in the room and I can't escape.
2820790	2823010	I have five minutes before she explodes.
2823010	2824790	What do I do?
2824910	2827090	Okay, I'm going to hand it off to Zardis.
2827090	2829450	He's the master of solving these challenges.
2829650	2836250	Tell us all about how DEF CON CTF adapted and what it took for these teams to compete and win.
2836870	2837710	Thanks.
2837830	2839410	Absolutely, DT.
2840070	2841030	All right.
2841030	2845350	I am Zardis from the Order of the Overflow.
2845570	2849950	It's great to be talking to you all again, even if it's virtual.
2849950	2873730	So this year, we faced a unique challenge, as did all of DEF CON, adapting what traditionally, since well before I even started coming to DEF CON, probably for well over 20 years now, has been an in-person hacker-to-hacker event.
2874110	2878370	And we're talking about the DEF CON Capture the Flag.
2878370	2892610	DEF CON Capture the Flag is the sort of championship that brings hackers from around the world to face off and identify who is the top hacking group out there.
2892610	2900650	In order to identify the top hacking groups out there, of course, I'll talk about how we identified candidates for them.
2900650	2907630	I'll talk about what we did in terms of challenges, in terms of different twists on the strategy and so forth.
2908490	2914750	In terms of setting up this CTF, it was crazy in a lot of different ways than it is normally.
2914850	2920150	Normally, we have a sleepless week, at least, integrating everything in Las Vegas.
2920310	2933530	This time, we had a sleepless week, at least, in addition to all the lost sleep, preparing for months ahead of time, integrating stuff over the internet.
2933530	2936610	But then you have unique, crazy scenarios.
2936610	2944010	One of my team members fell asleep at one point on the Zoom call, and we couldn't wake him up.
2944010	2951050	And he didn't pick up the phone, and we just had to wait until he woke up to deploy his challenge, for example.
2951050	2954570	So it was a pretty crazy set of scenarios.
2957730	2961570	An interesting thing, though, this year, we didn't have to argue with the fire marshal.
2961570	2968770	That was nice. Usually, we have to argue with the fire marshal about the amount of wires that we're running on the floors of the teams.
2969290	2978310	But this year, the challenge for us was to bring a little bit of Las Vegas to our hackers, since our hackers couldn't come to Las Vegas.
2978310	2981310	Let me talk about how we chose the hackers.
2981830	2990090	DEF CON, every year, uses this Olympic structure of selection of teams.
2990810	2993410	We have a number of pre-qualifying events.
2993410	2999410	By winning these pre-qualifying events, teams get an automatic invitation to DEF CON.
2999410	3009170	And then, additionally, after all of this, we run our own qualifiers to pull in teams that didn't win any of the pre-quals.
3009770	3018570	In terms of the pre-qual events, can you guys confirm that the slide changed?
3018570	3021530	No. Perfect, awesome.
3021530	3023990	All right, so things are working. This is incredible.
3024290	3029030	In terms of the pre-qual events, we had a whole bunch selected.
3029030	3034330	Some of them got wiped out, unfortunately, because of COVID. Events were canceled and so forth.
3034330	3043930	Other events went fully online, even though, traditionally, they have in-person final events of their own that we then draw from.
3043950	3055870	But we adapted. We had, of course, one pre-qualifying event that's last year's DEF CON CTF, which was won by Team PPP.
3055870	3063270	They qualified for DEF CON. There was a HITCON CTF this year. It was fully virtual. Usually, the finals are in Taiwan.
3063270	3068510	CTF Zone, with finals in Russia, usually, also virtual this year.
3069750	3074910	HXP 36 C3 CTF, which is usually an online in-person hybrid in Germany.
3075330	3080530	Also, actually, this year, I think it happened right before the whole COVID insanity.
3080530	3085710	So it was still online and in-person, along with HITCON, actually, so never mind.
3085710	3095970	And then PLAD CTF. And we pre-qualified a bunch of teams from that, five teams in total.
3095970	3103350	And the rest, we brought in from our own qualifying event, which we ran in April.
3103550	3111970	Sorry, originally, it was slated to go in April 4th. My daughter was due the week after, so we wanted to get it right in before that.
3112810	3124470	That was the main insanity of the early COVID time, so we moved it to May to let teams adapt to it.
3124470	3128370	And we used you guys as a break-in on the Discord, right?
3128370	3135950	Yeah, absolutely. DEFCON CTF Qualifiers was run on Discord, and it was wild.
3135950	3148670	It was in very early times. Riverside and the Goons were just incredible in adapting to our needs last minute.
3148670	3155830	It was absolutely wild. I think we went within three days before the competition to, like, what is this Discord stuff?
3156050	3162430	I always heard it was chat for gamers, but now it seems to be chat for hackers.
3162430	3164790	So it was really amazing.
3166770	3173830	So let me move from the... anyway, so we ran our own qualifiers.
3173830	3178750	We had a total of 16 teams, 13 of which we drew from the qualifiers.
3178750	3186070	There was a lot of overlap, so teams are really enthusiastic about CTF and about DEFCON CTF.
3186790	3202010	A lot of the teams that pre-qualified also pushed super hard, gave up a weekend of their lives to go crazy playing and competing in DEFCON CTF to qualify basically twice.
3202010	3206590	Though that didn't get them anything. They, you know, have that enthusiasm.
3208030	3214210	So we pre-qualified a whole bunch of teams from DEFCON CTF qualifiers.
3215050	3227730	Here's an interesting piece of data is all of the places from around the world that teams played, that teams connected from and interacted with our services for DEFCON CTF.
3227730	3232430	And it shows that this CTF is truly worldwide.
3232430	3239890	There's someone from every continent short of Antarctica, and maybe people in Antarctica were just going through a proxy.
3240970	3245390	So the whole thing was extremely global.
3245390	3252170	And let me show you the teams that qualified.
3252170	3254410	So we had 16 teams this year.
3254410	3261450	We had a lot of brainstorming on how we would run DEFCON CTF virtually.
3261510	3265950	As I said, it was usually an in-person competition.
3265950	3272190	We had designs that included 48 teams, designs that included 36 teams.
3272530	3287090	And in the end, we decided to do a more traditional 16-team CTF to get it, you know, perfect adapted online rather than while experimentation.
3287830	3295550	One of the order's founding principles is, you know, responsible innovation.
3295550	3301610	So we take this event very seriously because it is a very important event in the CTF community.
3301610	3308430	And so we wanted to make sure that we gave it the effort it deserved and the quality it deserved.
3308430	3313050	So the teams that we had were from all around the world.
3313050	3318330	And this was incredible, but also incredibly challenging, as I'll talk about in a second.
3318330	3341410	We had four teams from the U.S., eight teams from China, Japan, Korea, and Taiwan, and four teams from Europe, which made it extremely challenging to schedule the CTF.
3341410	3345670	Usually, DEF CON CTF runs during DEF CON. It's nice and easy.
3345670	3351970	So it's DEF CON, and it's during the day when the hotel is guaranteed to be open and so forth.
3353050	3357610	Traditionally, we have 10 hours on Friday, 10 hours on Saturday, four hours on Sunday.
3357610	3369750	This year, this didn't make sense because if we did that, all of the teams that are quarantined in Asia, for example, would be playing in the middle of the night all three times, and that would be a huge disadvantage.
3369750	3375790	So we went with this crazy idea of doing a shift schedule that was awfully painful.
3375790	3380390	Eight hours on, nine hours off, starting at 4 a.m. Las Vegas time, Friday morning.
3380510	3384810	This is basically the worst thing that you can do to a human being in terms of a sleep schedule.
3384810	3402110	That's probably better just not to sleep than to go through that, but we put everyone through that to spread out the pain more fairly so that this event could have that sort of fairness to it.
3402390	3406610	All right, so let's talk about the event itself.
3406890	3412770	We created 10 services for DEF CON CTF.
3412770	3423730	For those that don't know, the way that this competition works is every team receives copies, generally identical copies, of services.
3423730	3436150	Programs that we write that contain intentional flaws, and sometimes and very frequently unintentional flaws, that really explored a cutting edge of cybersecurity.
3436150	3444630	This year we created services that explored binary exploitation, that's of course traditional, binary versus engineering.
3444630	3451190	But we also had programs, challenges that explored concepts of automated program analysis.
3451190	3457630	We had a challenge where teams had to, using extremely constrained environments and extremely constrained inputs,
3458100	3471200	understand how to execute and exercise maximal code inside a crafted program that they receive.
3472190	3483100	There's a very common problem in software vulnerability research, and we basically created a CTF proxy for that.
3483100	3489500	We had challenges exploring adversarial machine learning and machine learning in extremely constrained environments,
3489500	3495840	and machine learning with classical vulnerabilities thrown in, implementation bugs, and so forth.
3496900	3500280	So two different challenges encompassing these concepts.
3500280	3506180	One of them was a video game where players created their own AI,
3506180	3514040	and in the video game there were vulnerabilities in the handling of this AI that the teams could use to their advantage.
3514060	3523520	We had white box cryptography challenges, or a challenge, where teams had to analyze and protect cryptographic protocols from each other.
3523520	3533620	We had challenges targeting historic computer architectures, exotic data flow parallel processing machines invented in the 60s,
3533620	3541020	for which one of our team members wrote an emulator from scratch, re-implemented, wrote an operating system,
3541020	3545740	and then wrote applications for that operating system for the teams to interact with.
3545740	3551380	Another challenge used Conway's Game of Life as the base of a computer architecture,
3553000	3556340	which provided a pretty exotic challenge for the players.
3556340	3563600	And then we had cutting-edge web security challenge exploring dependency injection in Node.js,
3563600	3576580	which teams patched and bypassed and patched and re-patched and re-bypassed throughout the entire final shift of eight hours of the game.
3576580	3587800	I'll give you some information just to get an idea of how insane the CTF is in numbers.
3587800	3592800	This is a graph of our network throughput to our team interfaces.
3592800	3601660	You'll see these are our shifts of eight, so that's why the network goes off when the CTF is off.
3601660	3607500	And you'll see over here at the end of the first shift, there was an adversarial machine learning challenge
3607500	3612300	through which the teams were pumping 70 megabytes a second of data.
3612560	3620380	And we have logged all of this traffic and it'll be available on the DEF CON media server.
3621980	3628060	There is a lot of traffic representing all sorts of exotic vulnerabilities, exotic exploitation.
3628060	3647320	This last shift here represents the team's attempt to leak out additional information on a cryptographic challenge that required multiple queries and so on.
3647380	3651960	You can see a similar trend in connections per second.
3651960	3659360	We hit, at one point, 1,000 connections a second. At one point, we hit a blip of 2,000 connections a second from the teams to our services.
3659360	3665840	At this point, infrastructure started melting down and we had to make some changes to stay alive.
3666380	3669340	But it was pretty incredible.
3669340	3677160	One thing that we were able to do by being online was scale out much, much, much more.
3677160	3690360	The CTF ran heavily on the cloud and we were able to give, for example, every team their own unique instances for every other team in certain cases,
3690360	3696940	so that there's less cross-team interference, except for in the services where that was part of the challenge.
3697240	3703280	We also had a ticket and response system for the teams to report problems to.
3703280	3713520	As you can see, it starts out in the first day and then as teams get more and more stressed and start stressing our infrastructure more and more,
3713520	3719060	they start reporting problems to us and we start dealing with them.
3719060	3723380	It's a whole crazy thing and no one's sleeping at any point in this endeavor.
3725380	3731600	One thing that we're very excited to announce this year is Archive.000.
3731600	3739780	This is a new feature this year. As we retired our services for the CTF,
3739780	3747500	so this year, if a team hacked a single service 600 times, you'll consider that service dead.
3747500	3750620	That service has been exploited and it is done.
3750620	3764500	This kept the game fresh. It also allowed us to have very specifically set rules for when we take a service offline and put it on Archive.000.
3764500	3770580	If you go to Archive.000, that is an actual top-level domain that you can resolve.
3770580	3780460	If you go to Archive.000, you can see a list of many, many, many challenges and services that we have written for previous years of DEF CON and this year of DEF CON.
3780460	3784960	I think so far we've pushed two out there and we'll push more over the next couple of days.
3784960	3789060	And you can actually click through, launch them, and try them yourself.
3791420	3803820	To give you an example, one team took about 17 hours to exploit the Parallel AF challenge that we've now pushed to Archive.org, Archive.000.
3803820	3807860	And so I would challenge you to go there and see how long it takes you.
3807860	3814080	It's an awesome way to practice, an awesome way to see what these teams are up against.
3814340	3821860	Before I move on to the teams and the results, I wanted to thank a number of people.
3821900	3827980	We could not have done this without the support of DEF CON.
3829020	3845700	This time around, we interacted heavily with Riverside, heavily with the development team, heavily with Dark Tangent, heavily with this amazing group that really created a space that feels just like DEF CON.
3845700	3852060	I was shocked by how much scrolling through the Discord challenges felt like walking through the hallways of DEF CON.
3852060	3854420	It was incredible.
3855220	3857420	We could not have done that without them.
3857420	3860560	I personally have to thank my team.
3861540	3864840	None of this would be possible without you all.
3864980	3870760	They're on a Zoom call right down there, but all their names aren't there, so I can't really show them to you.
3872880	3884700	But this has been a Herculean effort adapting to online, which in some ways is easier, in some ways is harder, and making all of this happen.
3884700	3889780	For me personally, I mentioned I had a daughter partway through DEF CON planning process.
3889780	3892060	This put me out of commission for about a month.
3893360	3898580	And they really, really, really stepped up and made this happen.
3898940	3908240	Our families, all of our families from OLL, we, you know, are sorry that you haven't seen us for several months, but we're back.
3908240	3910960	All right.
3912260	3914180	Moving on.
3914340	3917640	Let's talk about the teams.
3917640	3920940	So 16 teams entered, 16 teams exited.
3920940	3923980	Hopefully no one didn't exit.
3923980	3929620	Two years ago, we had someone pass out at the CTF floor because they hacked too hard.
3929720	3934220	This year, I'm not aware of any health emergencies like that.
3934220	3939140	So instead, I will just show the rankings.
3939140	3945840	So first, let's start with the top, no, the bottom 11 teams out of the 16.
3946560	3948800	These are all incredible hackers.
3948800	3955760	As I talk about this result, I want you to keep in mind this is in many ways the Olympics.
3955760	3965080	If you go to the Olympics and you, you know, throw your javelin and you get last place, you get last place at the Olympics.
3965100	3966560	So keep that in mind.
3966560	3982400	Even the teams toward the bottom of the scoreboard, they are incredible hackers that deserve an insane amount of respect for making it this far and competing in this game.
3982400	3994780	So starting from sixth place, we have Samurai, a team from the U.S. that are apparently huge machine learning experts.
3994780	4003420	I am very impressed with their performance on our machine learning challenges specifically and other challenges as well.
4003420	4008100	Shellfish, a mostly academic group from the United States.
4008100	4014280	Dicor, a team from Korea, also largely academic.
4016040	4021460	Bintw, a collaboration between Team Binja and Tokyo Westerns, both from Japan.
4021520	4025980	NorseCode from Sweden.
4026840	4030800	I might have fucked that up, but hopefully you're from Sweden, NorseCode.
4030800	4032880	Otherwise, I apologize profusely.
4034480	4038000	Starbugs from Korea, Korean Badass from Korea.
4039360	4041460	Macaroni from Italy.
4042020	4043920	RicaPig from China.
4044600	4046860	RPiSag from the United States.
4046960	4048780	And Pasten from Israel.
4048820	4052520	So there's a lot of teams from all around the world. They're all incredible.
4052520	4056380	They all made it this far. In order to make it here, they had to win events.
4056380	4061320	They had to place super high in qualifiers out of thousands.
4061320	4065340	I forgot to mention, for qualifiers, we had well, well, well over 1,000 teams.
4065340	4070440	I think we had just over, actually, for real, just over 1,337 teams.
4070440	4074760	At one point, it was holding steady at 1,337, and so no one registered, no one registered.
4074760	4077940	But I think it was like 1,340-something.
4077980	4085540	Anyways, out of those, these were the top 16 hacks, so they're incredible.
4085720	4088340	Let's move on to the top five.
4088340	4097880	In fifth place, hailing from Russia, Morbush Smoked Whackers, a collaboration of a number of amazing Russian hackers
4097880	4105540	that did an incredible job in our CTF, an incredible job in our qualifiers,
4105540	4112740	and also had previously pre-qualified by winning one of the pre-qualifier events completely.
4114840	4121240	They played really well, especially in one of the challenges that we created
4121240	4124840	to try to make the teams feel closer to each other by actually playing.
4124840	4131260	We built a little online game with very tricky vulnerabilities for them to exploit each other
4131260	4134060	since they couldn't meet in person in Vegas.
4136460	4142400	In fourth place, Tea Deliverers from China.
4142840	4146400	Tea Deliverers are also an incredible team.
4146400	4152300	To make it this far is an incredible feat of skill.
4152300	4154320	So great job, Tea Deliverers.
4154860	4160380	And actually, I forgot, I prepared a soundboard to clap for them.
4160380	4161760	This is a clapper soundboard.
4164060	4165740	Nope, not that, sorry.
4165740	4167040	Hold on.
4168020	4170340	All right.
4170340	4172320	Congrats, Tea Deliverers.
4172600	4178260	In third place, in DEF CON 28 CTF,
4179020	4184080	hailing from Taiwan, HITCON and BALSAN.
4188370	4192750	HITCON BALSAN is a collaboration of two teams.
4192750	4198810	Possibly even more, it's very hard for me to keep track of all of these team identities.
4199210	4203410	But it's a collaboration of amazing hackers from Taiwan.
4203530	4207070	They also host one of the pre-qualifying events.
4207490	4210110	Of course, they can't qualify through their own pre-qualifying event.
4210110	4214030	They qualified by doing awesome in our pre-qualifiers.
4215290	4217310	Awesome hackers all around.
4217310	4226470	We have, in second place, actually, let me show you the battle between second place and first place.
4226470	4234710	Because this CTF, in a lot of ways, from our perspective, was a story about this war of attrition between the top two teams.
4234710	4240310	It was insane to watch from this side of, I usually say, the table.
4240310	4245150	But there's no table, or there's a lot of tables, but this side of the network.
4246410	4249250	So we have a graph of scores over time.
4249250	4252310	I'll try to narrate it, if I can keep up as best I can.
4252310	4253390	And here we go.
4253950	4255210	Whoa, whoa, whoa, whoa, whoa.
4256410	4257790	Stupid Google, hold on.
4257850	4262270	We have to wait a little for it to reset.
4264890	4266270	It's gonna... oh, there.
4266270	4266950	All right.
4267170	4272770	Starting from the beginning of the CTF, very quickly, AOE, a team from China, as you know,
4273830	4278650	pushes to the top, is overtaken toward the end of the first day from PPP from the United States.
4278670	4285410	And for the rest of the game, except for some showings of, you know, more Bushmouth Whackers and then a couple of others,
4285410	4290910	it's really a game between PPP and AOE, going back and forth and back and forth,
4290910	4294930	fighting, patching, exploiting, over and over and over, right until then.
4294930	4297870	So right now, they're entering the last day.
4297870	4301610	And you can see they've overtaken each other several times already.
4301610	4304430	They... PPP was in first.
4304430	4307710	Now, AOE catches up.
4307710	4311370	Will PPP take the throne back toward then?
4311370	4315690	It was so, so close, but they didn't quite make it.
4315690	4319690	They were two points away when the game ended.
4319950	4330130	So in second place, a team that is a many-time DEF CON CTF champion, but not this year, but they were last year.
4330130	4336250	Second place in DEF CON 28 CTF, the Plaid Parliament of Pwning.
4342420	4356940	And in first place in DEF CON 28 CTF, incredible hackers fighting and clawing and exploiting their way all the way to the top.
4358580	4360300	AOE.
4364970	4366170	Congratulations.
4367510	4372410	That is the end of DEF CON 28 CTF.
4372550	4375030	I am Zardos from the Order of the Overflow.
4375030	4377290	Thank you for listening to my update.
4377290	4380110	To the teams, thank you so much for playing this game.
4380110	4388330	Hosting the CTF is an honor, and it is incredible to see the insane skills that you all possess.
4389150	4390510	Thank you.
4391390	4393870	Right on. Fantastic.
4394710	4396710	That was pretty intense at the end there.
4396710	4398970	I didn't realize the flip-flops happened so much.
4398970	4400270	Oh my God.
4400350	4402310	Another 30 minutes.
4403010	4403770	Yeah.
4405390	4411210	So we did a number, I forgot to mention, we did a number of public recaps that are now archived on YouTube, if you are interested.
4411510	4419810	Every day, we did one on Friday, one on Saturday, one on Sunday, discussing previous challenges that we had just retired and the state of the game.
4419810	4427330	And during the Saturday, the Sunday recap, I think first place switched like three times.
4427330	4428230	It was wild.
4428230	4432570	I was like watching out of the corner of my eye and trying not to freak out on camera.
4434350	4441090	So the winning team, AOE, as is tradition, they get a black badge.
4441170	4448070	And they are the only team, I mean the only contest winners to also get these custom embroidered leather jackets.
4448070	4455930	So AOE, if you are listening, you have got to get Zardos your jacket sizes so we can order your custom jackets.
4456090	4460590	And then you will get your, also we need to figure out a way to get you your black badges.
4460750	4463330	And what do the black badges look like this year?
4463330	4465870	Well, we don't actually know.
4465870	4467350	Let's show them the slide there.
4467350	4471830	I think there is components of an 8-track tape.
4471830	4475190	It looks like a coin from 1800s.
4475190	4477290	There is a phone dialer involved.
4477290	4480150	I understand there is electronics embedded in it.
4480770	4487830	I also understand that each badge that is being hand assembled contains its own challenge inside.
4488370	4492190	So the solving is not over yet.
4492190	4497450	So you will get your black badges sent to you as soon as they get finished being hand assembled.
4497450	4499990	And they are truly one of a kind, each one of them.
4500130	4503490	So again, congratulations on a fantastic game.
4503490	4507550	And this one was really hard fought, so the victory should be that much sweeter.
4508470	4510890	All right, let's move on.
4513270	4514390	This is what's happening.
4514390	4515250	We are winding down.
4515250	4519810	It's almost the end of the closing ceremonies and people have questions.
4520190	4521730	What happens next?
4521730	4527590	So we are gathering these hundreds of hours of video of DJs and music.
4528350	4533070	The video that Zardes talked about on the recaps, we've encoded the last couple of days.
4533070	4535870	They are on the media server as well as YouTube.
4536370	4541470	Our goal over the next month is to gather everything we can and make it available for you for free.
4541970	4548650	And right now on my other machine here is compressing away another 60 GB of village talks.
4548650	4554950	We will release a big torrent probably tomorrow of about 100 GB or so of video.
4554950	4562610	And then a month from now we will have the final torrent up with everything we can find, music, pictures, puzzles, anything.
4563130	4571350	So if you want anything to be contributed to that, e-mail us, direct message us on Twitter, go to theforum.defcon.org.
4571590	4575130	Just get a hold of us and get us the content and we will be sure to preserve it.
4577570	4579670	Also, let's go to the next slide.
4582150	4588630	As you heard listening to everybody, none of this would have been possible without all the departments.
4588830	4592930	I mean it was all hands on deck. And unfortunately, I've heard some people say,
4592930	4600170	hey, can we have Discord and in-person DEF CON at the same time? And there's no way we can do it.
4600170	4604070	I mean it took – you heard what it took to do this. We can't do both.
4605150	4610050	So instead, we are trying to figure out how to have elements of our Discord,
4610050	4615830	but not run 100% in Discord and 100% in person. That's not possible.
4617490	4623410	So here, let's go through some of these thank yous. And we are going to spend a couple of seconds on each page.
4623410	4630050	And I just want you to look at the total number of people that made it possible for us to be chilling here right now.
4630050	4634470	And I realize now I forgot to get a beer from the refrigerator before I sat down.
4634750	4641630	So you know what I'm going to do? I'm going to go get a beer while Pacey here goes through all the slides,
4641630	4649670	all the thank yous, okay? Can you do that? You got it. Okay, I'm getting a beer. Be right back.
4661520	4665880	I have to go back to work. I'm almost done.
4749500	4752100	Doesn't it feel like you are in the movies and they are rolling the credits,
4752100	4754240	and you are wondering is there going to be shawarma at the end?
4754240	4760420	Will there be an Avengers thing happening at the end or a secret unlock code that you have to put in your phone?
4760480	4761640	I could go for some shawarma.
4761640	4766460	What's going to happen? Oh my gosh.
4767360	4770960	So there is a special command you can type there, DT.
4772720	4775160	We'll be talking about that command shortly.
4785810	4789150	Let me see, that was workshops, contests, and events.
4846130	4851110	All right, there is my thank you.
4851890	4859990	Okay, so the question everybody has been wondering about, coming up, what is the future of our online Discord strategy?
4860230	4865470	And we debated this, and we debated it, and we have come up with a basic solution.
4865470	4872010	Here is what we are doing. We are basically closing everything on the Discord except a couple of channels.
4872010	4875990	We are going to have a voice and a text channel for the human plus.
4875990	4878090	We will have a text channel for the humans.
4878270	4886670	That should now be renamed any second to LionCon, because now you are almost in line for next year's con.
4887890	4892670	So when this is over, you are all going to get kicked out and dropped back into freaking LionCon.
4894130	4899690	Darington is going to roll some DEF CON movies every week now for a little bit.
4899690	4901290	We are going to do some hacker documentaries.
4901290	4904370	We are going to do some shared movie watching experiences.
4906170	4912250	And Chris AM is going to be doing some music and some DJs and some live events.
4912610	4918870	And some of the DEF CON groups have expressed interest in maybe doing DEF CON group meetups and mini-cons.
4919930	4926570	So the plan is restrict everything down to just a few channels so we can actually get a handle on it and moderate
4926570	4928910	and see if this thing gets out of control or not.
4928910	4934550	All the DevOps, we all want to go to sleep, but we also realize just how much fun this has been,
4934550	4936930	how incredible it is that we want to keep it going.
4937250	4940090	And then over the next couple of weeks, or maybe over the next month or so,
4940090	4944710	we are going to start thinking about how do we integrate this into a real show?
4944710	4947630	Like how can this be a companion to an on-site experience?
4947630	4952170	Does each village get one text channel that they can use while they are on-site?
4952370	4956910	We don't know. But we do know we want to keep it going, and we know we are going to keep a chat room open
4956910	4960710	for PLUS and for humans, and we will have some movies and we will have some music.
4961090	4964690	And then hopefully that will keep us alive until we come up with a better plan.
4964950	4969270	So you can go to the forums and you can help debate on the new plan.
4969950	4971270	Let's go to the next one.
4972050	4975890	We have been talking about CON. What is the future of the CON?
4975890	4979910	We have got a date. It is next year. This is what we are planning on.
4981210	4984890	We are planning on August 5th to 8th.
4984890	4991110	So that means we probably have to know if we are out of COVID by March maybe?
4993110	4998270	So unfortunately, we are going to have to plan again for a COVID future and a non-COVID future,
4998270	5001210	which is super stressful because it takes twice the effort.
5001210	5004190	We have to continue planning both paths at the same time.
5006950	5009730	Take pity on us, drink an extra one, pour some out for us,
5009730	5014530	because it is going to be a long six-month bumpy road until we know what we are doing.
5014890	5018770	But where might this CON be?
5020750	5026710	You know the place. Nothing has changed. Everything is the same in the world.
5026710	5034810	We will be going back to Paris, Valleys, Riviera, Hard Rock. No, not Hard Rock. What is it?
5035890	5041570	Link, Flamingo, Planet Hollywood. We are everywhere.
5041570	5049830	And part of the reason is because nobody has really used the big space at the new Caesars Forums,
5049830	5051630	and we don't want to be the first.
5052150	5058290	And the other thing is we are betting, if COVID still happens, we are betting we are going to shrink.
5058290	5060610	How many people are going to actually show up?
5060610	5064450	So if we are going to be smaller next year, we will be finding that space.
5064630	5069510	If all of a sudden tomorrow we have got a vaccine and everybody is healed and ready to go party,
5069510	5074010	we are going to start seizing more hotels, seize more resources.
5074550	5076270	So that is the plan.
5076870	5078230	Next slide.
5078230	5082790	This is the command that Riverside has been talking about, the custom-crafted command.
5082790	5087390	It is the Discord shutdown command, and we are about to issue it.
5087830	5092570	It might take up to a half an hour to run. We don't know, because you can't test it.
5092670	5096790	Because we are doing this in production, bastards. This is live.
5098030	5101670	So maybe you get kicked out right now. Maybe you don't.
5102150	5105390	Okay, Riverside, you have got the honors. Why don't you do a countdown for us?
5105390	5109830	Take off your mic and do a countdown. We will see if it spits us off into LionCon.
5110210	5113110	Thank you so much, everyone. It has been an honor and a privilege.
5113630	5121630	It has been really amazing, and it has really restored my hope in community and everything after a tough bunch of months.
5121750	5123110	It was awesome.
5124330	5125950	Okay, count it down.
5125950	5127470	There it goes.
5127710	5129330	Oh, tell them the name of the command.
5130230	5135830	Yeah, so our team has been having a really fun time with some of the commands and the goofiness.
5136190	5139190	Yeah, this one happens to be Cancel Defcon.
5141130	5142330	Canceling Defcon.
5144510	5147290	Defcon is canceled. That is awesome.
5147650	5152510	Here it goes. I think I might have to slow-mode that channel. They are going crazy.
5152670	5154830	Should I dial them back? Here it goes.
5155310	5156870	Did you count it down?
5157830	5163970	Five, four, three, two, one. Here it comes.
5164690	5167290	Cancel. Cancel it!
5170090	5174290	Okay, now I have to wait. I am going to go into LionCon and wait for people to pop in there.
5174710	5180310	Thank you, everyone. It was an amazing year, and hopefully we will see you in person next year.
5181110	5182010	Peace out.
5182010	5182790	Later, all.