Twitter, Inc. · GitHub

COLLECTED BY

Organization: Archive Team

Formed in 2009, the Archive Team (not to be confused with the archive.org Archive-It Team) is a rogue archivist collective dedicated to saving copies of rapidly dying or deleted websites for the sake of history and digital heritage. The group is 100% composed of volunteers and interested parties, and has expanded into a large amount of related projects for saving online and digital history.

History is littered with hundreds of conflicts over the future of a community, group, location or business that were "resolved" when one of the parties stepped ahead and destroyed what was there. With the original point of contention destroyed, the debates would fall to the wayside. Archive Team believes that by duplicated condemned data, the conversation and debate can continue, as well as the richness and insight gained by keeping the materials. Our projects have ranged in size from a single volunteer downloading the data to a small-but-critical site, to over 100 volunteers stepping forward to acquire terabytes of user-created data to save for future generations.

The main site for Archive Team is at archiveteam.org and contains up to the date information on various projects, manifestos, plans and walkthroughs.

This collection contains the output of many Archive Team projects, both ongoing and completed. Thanks to the generous providing of disk space by the Internet Archive, multi-terabyte datasets can be made available, as well as in use by the Wayback Machine, providing a path back to lost websites and work.

Our collection has grown to the point of having sub-collections for the type of data we acquire. If you are seeking to browse the contents of these collections, the Wayback Machine is the best first stop. Otherwise, you are free to dig into the stacks to see what you may find.

The Archive Team Panic Downloads are full pulldowns of currently extant websites, meant to serve as emergency backups for needed sites that are in danger of closing, or which will be missed dearly if suddenly lost due to hard drive crashes or server failures.

Collection: ArchiveBot: The Archive Team Crowdsourced Crawler

ArchiveBot is an IRC bot designed to automate the archival of smaller websites (e.g. up to a few hundred thousand URLs). You give it a URL to start at, and it grabs all content under that URL, records it in a WARC, and then uploads that WARC to ArchiveTeam servers for eventual injection into the Internet Archive (or other archive sites).

To use ArchiveBot, drop by #archivebot on EFNet. To interact with ArchiveBot, you issue commands by typing it into the channel. Note you will need channel operator permissions in order to issue archiving jobs. The dashboard shows the sites being downloaded currently.

There is a dashboard running for the archivebot process at http://www.archivebot.com.

ArchiveBot's source code can be found at https://github.com/ArchiveTeam/ArchiveBot.

TIMESTAMPS

The Wayback Machine - https://web.archive.org/web/20190501182228/https://github.com/twitter

Please note that GitHub no longer supports your web browser.

We recommend upgrading to the latest Google Chrome or Firefox.

Learn more

finatra

Fast, testable, Scala services built on TwitterServer and Finagle

testing http microservices framework scala slf4j thrift

Scala 1,902 348 Apache-2.0 Updated May 1, 2019
pants
Forked from pantsbuild/pants

Pants Build System

Python 65 322 Apache-2.0 Updated May 1, 2019
util

Wonderful reusable code from Twitter

utility scala finagle

Scala 2,269 498 Apache-2.0 2 issues need help Updated May 1, 2019
finagle

A fault tolerant, protocol-agnostic RPC system

mysql java redis http memcached distributed-systems scala

Scala 7,059 1,256 Apache-2.0 10 issues need help Updated May 1, 2019
twitter-server

Twitter-Server defines a template from which services at Twitter are built

finagle finatra

Scala 999 169 Apache-2.0 1 issue needs help Updated Apr 29, 2019
netty-http2

HTTP/2 for Netty

Java 91 42 Apache-2.0 Updated Apr 26, 2019
twitter-kit-ios

Twitter Kit is a native SDK to include Twitter content inside mobile apps.

Objective-C 611 201 Updated Apr 26, 2019
scalding

A Scala API for Cascading

Scala 3,132 662 Apache-2.0 Updated Apr 25, 2019
scoot

Scoot is infrastructure to make developer tools smaller, simpler, and more distributed.

Go 44 14 Apache-2.0 Updated Apr 25, 2019
rpc-perf

A tool for benchmarking RPC services

Rust 284 35 Apache-2.0 Updated Apr 24, 2019
GraphJet

GraphJet is a real-time graph processing library.

Java 457 52 Apache-2.0 Updated Apr 23, 2019
rsc

Experimental Scala compiler focused on compilation speed

Scala 1,213 35 Updated Apr 23, 2019
summingbird

Streaming MapReduce with Scalding and Storm

Scala 2,022 262 Apache-2.0 Updated Apr 22, 2019
scrooge

A Thrift parser/generator

android java scala lua thrift cocoa code-generation

Scala 667 213 Apache-2.0 6 issues need help Updated Apr 19, 2019
ossdecks

Repository for Twitter Open Source Decks

7 3 Updated Apr 18, 2019
dodo

The Twitter OSS Project Builder

sbt util finagle scrooge twitter-server finatra twitter-oss

Shell 14 5 Apache-2.0 Updated Apr 17, 2019
pelikan

Pelikan is Twitter's unified cache backend

C 536 55 2 issues need help Updated Apr 16, 2019
twemoji

Emoji for everyone. https://twemoji.twitter.com/

JavaScript 9,826 1,129 Updated Apr 16, 2019
storehaus

Storehaus is a library that makes it easy to work with asynchronous key value stores

Scala 451 78 Apache-2.0 Updated Apr 15, 2019
finatra-misc

Miscellaneous libraries and utils used by Finatra

Scala 3 5 Apache-2.0 Updated Apr 11, 2019
twemoji-parser

A simple library for identifying emoji entities within a string in order to render them as Twemoji.

JavaScript 14 1 MIT Updated Apr 3, 2019
twitter-cldr-rb

Ruby implementation of the ICU (International Components for Unicode) that uses the Common Locale Data Repository to format dates, plurals, and more.

Ruby 571 67 Apache-2.0 Updated Apr 2, 2019
twitter.github.io

A listing of open source efforts at Twitter on GitHub

JavaScript 1,153 449 Updated Apr 1, 2019
hogan.js

A compiler for the Mustache templating language

JavaScript 4,988 430 Apache-2.0 Updated Mar 29, 2019
commons

Twitter common libraries for python and the JVM

Java 1,734 476 Updated Mar 29, 2019
wordpress

The official Twitter plugin for WordPress. Embed Twitter content and grow your audience on Twitter.

php wordpress twitter-cards twitter-plugin

PHP 230 82 MIT Updated Mar 28, 2019
sqrl

A Safe, Stateful Rules Language for Event Streams

TypeScript 10 2 2 issues need help Updated Mar 13, 2019
twurl

OAuth-enabled curl for the Twitter API

ruby cli twitter twitter-api curl

Ruby 1,236 218 MIT Updated Mar 12, 2019
diffy

Find potential bugs in your services with Diffy

Scala 3,407 316 Apache-2.0 Updated Mar 5, 2019
AnomalyDetection

Anomaly Detection with R

R 2,900 661 GPL-3.0 Updated Mar 1, 2019