Hi, everybody. Welcome back. And it looks like our next talk will be by Andrea Myershen. So her talk will begin just shortly. So this is a prerecorded video, but she will be doing a live Q&A a little bit afterwards. Unfortunately, due to some scheduling, it looks like her video will commence at about 12 o'clock to 1.40 PDT. And she will be joining us about 1.40 PDT Pacific Time to give us a live Q&A. For those of you who have any questions, she'll be presenting on her Vote at Home project that she's been working on. And yeah, I will, without further ado, I will start presenting that. If you all have any questions, let us know. With the recognition that 2020 has been an extraordinary year and the confluence of the pandemic with major... Welcome back to the DEF CON Ethics Village. I'm Andrea Myershen from Penn State, one of the co-organizers of the village. And this is the Vote at Home workshop. During this session, I'm going to introduce you briefly to a project that my lab, the Policy Innovation Lab of Tomorrow, or Pilot Lab, is working on. And I'm going to ask you, should you be so inclined to help us a bit by making the project even better and extending its reach through the use of your various unique skill sets. So at this point, I'll share my screen and tell you a bit about the project. The Vote at Home workshop, in this case, is, as you might expect, about expanding the ability of voters to vote at home. So this is the homepage, and should you wish to check it out at this juncture and kind of follow along as I'm talking about it, please feel free. The one warning that I will give you immediately is that for reasons that will become apparent during the talk, we haven't had time to optimize it yet for mobile. So if you are looking at it on a machine, it should render properly. If you are attempting to check it out with a mobile device, urban tragedy will ensue and everything will be unusably mangled. So at this juncture, please indulge us with your patience and check it out on a regular machine. So what this project is and how it got started was partially with the recognition that 2020 has been an extraordinary year and the confluence of the pandemic with a major election cycle, including a presidential election and elections for members of the Senate and the House, caused a blend of two sets of events that don't work well together, in particular because so many Americans vote in person. And so it's with that that the thought occurred to me, hey, why don't I just go check out and see what kind of informational sites there are currently available and to see whether there was an organization to partner with to have my lab do its part in encouraging the spread of civics education and voter education to ensure that every American has a fair shot at the information required to exercise each of our franchise rights. So I took a closer look and there are some wonderful resources out there, but what I realized is that all of these voting sites, or almost all of them, could in one way or another go one step further. So specifically, many of the sites refer voters to secretaries of state websites, which is great, but then they don't really walk through individual secretaries of state websites and some of them are not organized in a way to help people to succeed. Other sites are more of a black hole where you type in your information and they may send you an email later or something like that, but it didn't really give me a sense of confidence that a voter would end up, at the end of the day, understanding what was going on with her information and be sure that there was a chain of events that would lead to her having a ballot counted. So with those concerns layered on top of the fast pace of changing information in various states and noticing that even some highly reputable organizations had information on their websites that was already out of date and didn't reflect what I knew to be the current state of affairs The first one is, I was just wondering, as you were talking about the legislation and how it was based on legal wrangling and changes in law, I thought, okay, maybe there's a space here to build something that's a little different, that's focused specifically on helping voters walk through each step, give them the scaffolding to succeed. And also, importantly, to take a focus away from just casting a ballot but also on ensuring that the voter has the best shot of having her ballot be counted in the election tallies. So, I realized that many of these websites that are helpful and run by organizations providing a great public service, they were nevertheless a bit optimistic. So, they tend to assume that a Secretary of State website or a county website would be usable by an average voter and that the information was finalized in advance on those sites, which, unfortunately, wasn't always the case. Similarly, many of these organizations appear to presume that the websites would be arranged in usable ways and, unfortunately, that definitely wasn't the case in some Secretary of State websites or certainly not county websites. So, the implicit assumption is also that a voter has a lot of patience and time to scroll through and click through things to dig up the information that is required to get a handle on the process end-to-end from the point of registering to vote all the way through to casting, requesting an absentee or mail-in ballot, casting that ballot, and trying to give yourself the best shot of assurance that the vote was ultimately counted. And perhaps most troublingly to me, I realized that looking at some of the deadlines on Secretaries of State's sites, that based on the way that current post office delivery times were running, there was going to be a problem that emerged along the lines of delivery times not allowing for things like signature challenges to get corrected in a way that allows the voters' vote to still be counted. So, that concerned me because the confluence of the pandemic and the logistics of extra mail, etc., could result in certain voters not having a fair shot at correcting ballots with minor imperfections. So, those concerns that are unique to 2020 made me worried that perhaps many sites were a little too optimistic in the way that they were framing information for voter consumption. So, we decided to take a crack at this. And in this way, the Vote at Home project was born. It's called Project Retriever, like a dog or other animal that fetches things. In this case, we're helping to fetch ballots. And you can vote on what kind of animal should be the official retriever at the bottom of the homepage. So, the URL is listed here at the top of the page. And so, it's pilotlab.org backslash vote. That will take you to the homepage. And our goals are relatively simple. So, first, to make sure that voters are aware of all of their options to mitigate the risks of in-person voting due to the COVID-19 pandemic. In particular, I noticed that the possibility of receiving a ballot by mail, but then returning it in person is something that most states have, but it's not necessarily well known to voters. And that seems like a hybrid opportunity to mitigate some risk and yet to get a greater feeling of assurance that your vote has arrived at the point of the election commission or auditor. The various bodies are called different things in different states, as you'll see by the site. So, the second framing is around helping to give voters the best shot that their votes will be counted. So, this isn't so much about encouraging people just to submit requests or just to submit their ballots, but to give them the information, to arm them with the information to make sure that they vote in a way that maximizes the potential for their votes arriving in the correct places at the correct times and to be counted with the greatest level of certainty. Third, it was important to me that the information was presented in a nonpartisan way. And so, all of the sources that are linked on this site are official government sources. They've just been arranged in a way to help the voter understand the flow of the process in the clearest possible way. Hopefully, you'll tell us if that's not the case. So, with that, the next goal is precisely that kind of user interface. A one-stop-shop, streamlined approach that's state-specific, that is self-contained in a single image, basically a single flowchart, ideally. Though, I will point out that there were a couple states that the process is unfortunately complicated enough that two connected flowcharts were required. So, that was an interesting observation that I ran across as I was building these flowcharts. So, the goal here is also to have high accuracy, trustworthy, current information. And so, this project will be updated on a regular basis with the assistance of a postdoc and a research assistant or two and the kind people of the internet, I hope. And so, ideally, we'll end up with an easy-to-follow set of explainers for voters to help them be set up for success and to give them the confidence that their process of voting had sort of maximum legitimacy and that their votes were likely counted correctly in the way that the intent of the voter would dictate. So, this all seemed doable and we started building. So, my postdoc, Michael Antonino, who is giving a talk tomorrow morning or I guess early afternoon, depending on which time zone you're in. Tomorrow, Sunday, in the Ethics Village, Michael Antonino will be talking about blackmail and extortion, so something completely different. But he's been very helpful on this project as well. So, Mike did an initial cut on aggregating some of the state-specific information for a set of criteria that I thought would be good to include in these flowcharts. And then he also started making video content because we figured helping with engagement once these 50-plus flowcharts were made that that was going to be a major challenge. So, I started making flowcharts and I thought this would be a relatively straightforward process, just a bit time-consuming. It was not a relatively straightforward process. So, this project has been going on for over two months and it's still not finished. In fact, some states haven't finalized their voting processes and we're less than 90 days to the election. So, it's gotten to the point where we are emailing and calling individual county offices in certain states to try to figure out what the voting process is for the citizens of their jurisdictions. And as I mentioned previously, it's definitely not mobile optimized yet. But what was somewhat startling to us is that there are counties that don't even have websites and that the Secretary of State of one state in particular has merely a direction, when we last checked, to go to the individual counties and ask them. So, there have been challenges getting some of this information, though allegedly that particular Secretary of State is going to have some guidance released soon. So, with that, here are a few observations of things that I noticed as I was making these flow charts about the way that some of these election structures have been set up. So, there were a few Secretary of State websites that left me with an impression that maximum voter registration was not necessarily the goal. I was surprised that in at least one case, when you type in the words voter registration into the search bar on the Secretary of State website, there was no usable information that came up. Even in the formal FAQ for voters in that particular Secretary of State website, the process of registration was dismissed. Now, ultimately as you'll see if you figure out which state I'm talking about here, there is a national postcard format for voter registration. So, that particular flow chart links to that national document that is put out by the Election Assistance Commission. But, the process was not transparent from the way that the website was set up. They didn't even really describe it. So, I can't say the way they described it. Other states have set up signature challenge processes that in my mind are signaling that they intend to use signature challenges somewhat aggressively. And so, the kinds of secondary issues that flow from that signature challenge posture and set of processes is that in situations where you have postal delays, as I mentioned, you may not be able to have the round trip of a voter mailing in a ballot, having a signature challenge occur, or sending in a request for an absentee ballot and having that request deemed to have a non-conforming signature and then get tossed out to leave the voter without necessarily enough time to try again and correct whatever imperfections existed. In some states in particular, they've signaled that if your signature doesn't look identical enough to the way that you signed your driver's license or the way that you signed your voter registration card, for example, if one has a middle initial and the other signature doesn't, or if you signed with only an initial and your last name on one but you signed with your full name on another, those kinds of minor mismatches are enough to disqualify a particular request for an application or a particular ballot if that signature on the outside of the envelope is non-conforming to the baseline of whatever the document is that they're using. And sometimes the baseline of which document it is and which signature it is is not always crystal clear. In some states, they encourage you to update your signature so that you are sure that there will be a match. But this is something that many voters would not necessarily anticipate to be a dynamic that would impact their voting process. There are some states that have relatively late ballot mailing dates in the middle of October. While under normal circumstances, that may not be an unduly short time frame for a round trip of requesting a ballot, getting a ballot, and sending it in even with perhaps a challenge on the back end of that. In a situation where we have a significantly greater number of people requesting ballots by mail and where you have postal delays, as we've already been seeing, that is adding to the stress on the system and again making it more likely that a voter may face challenges. The latest guidance from the U.S. Post Office is to plan 15 days for transit of a ballot. Most voters are unlikely to expect a need for a 15-day planning window, a buffer for their vote to make it back to their election officials for purposes of counting. And then finally, there are states that have some unique quirks. For example, one state requires that the voter type out the exact date of the election that the voter is seeking to participate in. While in most other states, there's sort of a checkbox, general election, primary, and maybe they even provide the date next to the checkbox that you might be choosing. But in this particular state, they are very clear that if you get the date of the election wrong at all, when you type it out or write it out by hand, your request for a ballot will be excluded. There are also states that require a copy of a photo ID for receiving a mail-in ballot, even if you're already registered to vote. Other states require notarization of your ballot request or your actual ballot. And some states similarly request witnesses. In some states, those witnesses must be voters. In other states, they only need to be adults over age 18. Some states pay postage on the return envelopes for ballots, but other states do not. And some of those states that don't have a disclaimer and a warning that voters need to apply enough postage, but they don't necessarily tell voters what amount is the necessary postage that should be affixed to a particular ballot. So the actual stamp count is not necessarily clear. So that's something else that voters might be unprepared for or find challenging to ascertain. And then in one case, there was a situation where a state had a county that was subject to the requirements under the Help America Vote Act to translate materials into Spanish because of the number of Spanish speaking residents. And the county had one line of Spanish on the website, which just basically referred Spanish speakers to the English version of the site. So we contacted them and we asked where the Spanish language materials were. We didn't get an explanation, but what was interesting is that poking around on the website, we were able to uncover an archived copy of an earlier set of translated documents that were no longer linked up. And they were from a prior year, so perhaps they were out of date. But nevertheless, there was sometimes the risk of a language barrier that might prevent some citizens from fully participating in the electoral process. So these were some of the concerns that we had in mind. Okay, so as of today, here's what's done. We have flowcharts for almost every state finished. The basic structure of every page is finished. There are non-copyright infringing photos that are different for every state. And I'd just like to put in a plug for any of you looking for a novel market opportunity. The world needs more attractive mailboxes. There was a shortage of attractive mailbox pictures in the public domain. I went through a lot of pictures of mailboxes. And there are a lot of really unattractive mailboxes in this world. So believe it or not, this actually became sort of a bit of a problem because we wanted to get a unique mailbox for each state as a sign of respect, if nothing else. And so it became a bit of a challenge finding those last few mailboxes. And you'll see on a later slide that this is one of the items that we flag as possible optimization. So what's not done? The mobile optimization, not done, but it's in progress. There's a learn here more button on the front of the site on the homepage. That's also in progress and that's just going to be a discussion about the differences of kind of the risk mitigation of different ways of voting and the options in general of the three possible methods. So request a ballot at home, receive it at home, request a ballot at home, drop it off in person or voting in person. Proofreading, not done. Translations, not done. There's a new section for each state that we're building out and so that's in progress. There is a very elaborate spreadsheet that's fast on its way to being updated and also that will stay current. Getting the word out and getting some viral spread to help people realize that there is a potentially useful resource, that is obviously not done because the site's not done yet. And the state of Mississippi, not yet finished partially because they're still finalizing their processes. So your help would be very much appreciated with proofing states. Some of the states even that are done, they need to do a... they need a refresher because of the slipping delays with the post office. So some of the earliest states on the flowcharts, they may have had buffer dates that were not a full 15 days out because at that point in time the guidance was 7 days out. So some of the dates may need to be refreshed. A bunch of them I caught, but some of them I may have missed. And so the translations would be something that would be a section that for those of you who are gifted in various languages help would be much appreciated. And in particular getting the word out about the existence of this resource to voters who might find it helpful would be very much appreciated. So first proofing, so if you go to pilotlab.org backslash vote on a machine again because, you know, see lack of mobile optimization supra, but that will happen I promise. You can start proofing by picking a state, any state, and you should see a pop-up come up. The pop-up will either say high volume state or high volume election depending on whether there is a likelihood that a particular state will have a potentially contentious race with an unusually high volume of ballots by mail comparatively. So when you see the pop-up come up, well first does the pop-up come up, check it out, see if there is a typographical error or anything looking off, and then click through it to the flowchart. So each state has a unique flowchart and unique photos and unique content. So please look for bugs, look at the flowchart, attempt to follow the steps on the flowchart. Are the links correct? Are the flowcharts intuitive? Is the mailbox picture acceptable or is there a mailbox picture that you take a look at and you think, wow, that's insulting. That's an insulting looking mailbox. Not our intent at all, but there were two states where I already got feedback that the particular mailbox that was selected looked a little sad. Understood, swapped out image. So hopefully those mailboxes look nicer now. So is there a mailbox that looks particularly ugly or weird? Or is the other photo, which is intended to be state specific, a good choice for highlighting the particular state? Each state has lovely parts to it, and so each state deserves to have its natural beauty highlighted. Are there other user interface issues? Is there something that looks a little off? Is there an arrow that somehow moved over somewhere where it shouldn't be? Are there layout problems? Other things? Make note of all of this. All of these kinds of comments are much appreciated. And at the bottom of each page, there is a as you can see from the image on the slide, there is a link that takes you to a feedback form where you can type in the state, choose from a drop down set of issues, one of which is other, and tell us what optimization or correction you would recommend. Also, make note if you see that there might be some process problems of the kinds that I was mentioning, where a voter might not expect to have a challenge in the way of her vote being counted. So, is there some kind of process vulnerability that we missed? Walk through the flow chart, for example. Here is one example in the state of Kansas. The timing of the mailing out of the absentee ballots does not appear to leave enough time for that round trip of the ballot in case of a signature challenge. So, think about the registration process, the process of requesting a ballot, the process of returning the ballot, and the possibility of a challenge post-return where the voter will be asked to demonstrate the entitlement to cast the ballot or to correct the ballot in some other way because of the way that the voter filled it out. Same thing, let us know. Use the feedback link on the bottom of each page, please. Second, translations. Perhaps you are lucky enough to speak one or more languages other than English. Or perhaps you have a particularly gifted multilingual friend. As my friends often find out, requests to help me with my projects are a regular occurrence. So, maybe you have a really generous friend that will also want to help us out with this project that just kept getting bigger. So, please help us out. If you click on the translate drop-down. So, on the home page there is a language drop-down. The translate is at the bottom of the various language choices. So, if you pick a state, you take a look at the flow chart and if you translate step-by-step the steps are actually numbered. And so is the form, as I will show you here. Go down to the translate drop-down. That opens an interface for translation. And there are numbers for steps. And each state then has numbered steps as well in the flow chart. So, for example, step 1 could correspond to step 1 there. All languages are welcome. The list of languages in the drop-down is not intended to be exclusive. It's purely the happenstance of the various languages that we have ready access to. And even so, the volunteers who speak those languages are sometimes time-limited and so they can only contribute in one state or two states. So, just because a language is represented does not mean that we have full coverage on it. So, if you happen to be fluent in that language, please go for it. Please take as many states as you can stomach translating and contribute your multilingual skills to this project. It would be much appreciated. And so, third and finally, the process of helping us get the word out and keeping things current and updated. So, the site is going to be final by August 17th. So, at that point, we're going to start pushing it out through various media, hoping to get it into the view of voters who might be assisted by it. So, if you would be kind enough to help us spread the word through your social media accounts or otherwise lists, email lists still exist. I'm on a lot of email lists. Or whatever other means that you wish. There is another form on the site. It's at pilotlab.org backslash tellme. And so, if you'd be kind enough to fill in some kind of desired greeting, whatever that may be. It doesn't have to be your name. We don't really need that necessarily. It's just a contact method. And this is purely for the purposes of this project to let you know that the project is finished so that you can, if you're kind enough to assist us in rolling it out. We will be destroying this information after this project. So, one shot thing. Pilot Lab doesn't keep lists. I can tell you that with certainty because I manage the social media accounts and I don't have time to keep lists. So, this will be a one shot deal if you're kind enough to contribute some contact information to this and help us with this rollout. So, on the 17th when the site is done, we'll send you a little notification that the site is done. Or if you would prefer to just throw it on your calendar for the 17th that would be great too. Right around there. Maybe a little bit earlier. I hope. It might be earlier. I'm hoping. So, after that once it's been sort of officially launched, there's always the challenge of ongoing currency. So, as I mentioned, we are monitoring news stories in every state around developments in voting at home. And it is nevertheless useful if you happen to run across a story that's relevant to a particular state to make sure that we've seen it. If it's not already listed in the news section on that site, if you'd be kind enough to tweet it at us, that would be really helpful. There are two Twitter accounts that Pilot Lab runs. One of which is linked off of the homepage at the bottom under contact. But also, this is a Pilot Lab project the Penn State Cows, which is an ag tech IOT rural broadband project. But if you like cows or sheep or goats or llamas or alpacas because they're different. They're completely different. This feed might be to your liking. So, the almost 900 now followers are almost entirely farmers from all over the world. And InfoSec Twitter has nothing on Ag Twitter. That is all I will say. I've learned a lot in the last year running this account. And I look forward to getting into conversations with any of you about the different methods of bathing sheep or hoof trimming, which is a theoretical matter I now know a lot about. Maybe someday I'll actually learn how to do that in practice. But I don't have those skills, but I can ask some questions about those topics now. Anyway, I'll stop. So, tweet at the Penn State Cows. Another great way to get our attention with news stories. Drop us an email to pilotlab.psu.edu or feel free to use the feedback form on the bottom of the relevant state that's the subject of the news story. Whatever means is convenient. We just appreciate your contributions because keeping this current is going to be a challenge, of course, but we will do our best. So, you'll be familiar with the feedback form at the bottom of these pages, I'm sure. And then finally, and this is my last slide, third-party attacks may have already started on various states' voting at home structures, which isn't a good sign. Fairfax County pushed out on Facebook a warning to its followers that some mailings have already started showing up in mailboxes of voters that create the impression that they are from Fairfax County. They are not actually from Fairfax County. Because of this warning, I realized we needed a potential scam alert page. When some activity that is verified and raises concern of potential voter confusion comes up, it will be added to this potential scam alert page, and as you can see on the Virginia example that's on the slide, there will be a notice advising voters to check out what's going on with the particular questionable conduct. So, if you run across some mailings, posts, that appear to be trying to confuse voters and are from a source that is misrepresenting itself as an official government source, for example, such as this case that Fairfax County's impression of the particular mailing at issue, please let us know through either the feedback form on the bottom of the page for the relevant state, or if you go to the URL that's listed here, pilotlab.org backslash votescams, you can also submit that information through another interface on that page. Or, feel free to tweet it at us, drop us an email, all methods are welcome and much appreciated. So, I will leave the slides there. The URL is, again, pilotlab.org backslash vote. I'll just put it back to the front here. I will be around for Q&A after this. If any of you have specific questions about the project or about particular states, I'd be happy to engage with you. Any contributions of your time that you can give in connection with this workshop would be greatly appreciated because 50 plus is a lot of states. We're a very large country. So, thank you for your attention and thank you in advance for your contributions of time to this project. Hi everybody. So, thank you again for attending that pre-recorded talk. So, just as a heads up, Andrea is actually in the chat right now for general text. She will be available and taking live questions starting at 1.40 p.m. Pacific time. So, please stay in the chat. I know it's 12.40 right now, so about an hour, give or take. She'll be around, if not now, to start fielding some questions. Also, as we go forward, after about, let's say, 2.10 p.m. PDT Pacific time, we're going to have the Federal Trade Commission Commissioner Rohit Chopra follow the same format. He's going to have a pre-recorded talk, but we'll be taking live questions again after his pre-recorded talk. Following his presentation, we'll have Jessica Wilkerson of the Food and Drug Administration as well. She also has a pre-recorded talk, but we'll be fielding live questions after that. And to end the day today, also, we will have Liza Logan of Tech Congress. So, Liza will be fielding questions after the pre-recorded talk. And, yeah, stick around, I guess, for a little bit longer. Please talk amongst yourselves until we continue. And thank you again for coming to DEF CON slash Ethics Village 2020. If you have any questions, let us know. Hi, folks. For those of you that are in the EV Talks voice, once again, we will be having a live discussion from the last video, a pre-recorded talk by Andrea, or known as Adgracy, in the chat. If you missed anything, I have just pasted the YouTube link where you can watch portions or the whole video again. It will be starting at 1.40 p.m. Pacific time. If you have any questions in the meantime, please feel free to queue them up inside the chat, and she will get to them accordingly. So, yeah, I'll see you all soon. Alright, folks. We're about to get started here in a few. I think we have... Andrea, can you hear us in the chat? Or can you hear me? I can hear if you can hear me. Awesome, awesome. So, everybody, if you have any questions regarding the presentation that just occurred with the Vote at Home workshop, please post them in the chat now. Anything... folks have been slowly asking some questions, I believe. I saw there was some mailbox shaming discussion that amused me. We can talk a little bit about some of the maybe cool mailboxes you've all seen, or if it is ethical to have a crappy mailbox to annoy your housing, your HOA folks, or what have you. But please post your questions in the chat. Right now, I'm going to introduce our speakers. So, Andrea, how do you pronounce your last name? It rhymes with sedition, tuition, extradition, my kind friends say magician, rendition, you know, there's a lot. So, for those of you that were here yesterday, I've been butchering people's names, we have Andrea Matt-Busham, and a little bit about her. So, she is the Associate Dean of Innovation, Professor at Penn State Law, University Park. She is a Professor of Penn State Engineering, and she's also the Founding Director of the Penn State Policy Innovation Lab of Tomorrow. I don't know if you all heard, we're here for yesterday's talks, but there were several representatives of the pilot lab as well. So, without further ado, if you all want to start fielding some questions, please feel free. But before we begin, what is the most horrible mailbox you've seen so far, Andrea? The ones that my friend Miranda made me replace, because she was horrified that I would even consider leaving them up. There are a lot of well-loved mailboxes, like wooden ones that have been around for a long time, and... am I still...? Well-worn ones that have been weather-battered and well-loved and well-used by many series of homeowners, and so there were a few of those that were just sort of washed out, the wooden planks were washed out from the elements, or there were...