GitHub - criticalstack/libevhtp: Create extremely-fast and secure embedded HTTP servers with ease.

COLLECTED BY

Organization: Archive Team

Formed in 2009, the Archive Team (not to be confused with the archive.org Archive-It Team) is a rogue archivist collective dedicated to saving copies of rapidly dying or deleted websites for the sake of history and digital heritage. The group is 100% composed of volunteers and interested parties, and has expanded into a large amount of related projects for saving online and digital history.

History is littered with hundreds of conflicts over the future of a community, group, location or business that were "resolved" when one of the parties stepped ahead and destroyed what was there. With the original point of contention destroyed, the debates would fall to the wayside. Archive Team believes that by duplicated condemned data, the conversation and debate can continue, as well as the richness and insight gained by keeping the materials. Our projects have ranged in size from a single volunteer downloading the data to a small-but-critical site, to over 100 volunteers stepping forward to acquire terabytes of user-created data to save for future generations.

The main site for Archive Team is at archiveteam.org and contains up to the date information on various projects, manifestos, plans and walkthroughs.

This collection contains the output of many Archive Team projects, both ongoing and completed. Thanks to the generous providing of disk space by the Internet Archive, multi-terabyte datasets can be made available, as well as in use by the Wayback Machine, providing a path back to lost websites and work.

Our collection has grown to the point of having sub-collections for the type of data we acquire. If you are seeking to browse the contents of these collections, the Wayback Machine is the best first stop. Otherwise, you are free to dig into the stacks to see what you may find.

The Archive Team Panic Downloads are full pulldowns of currently extant websites, meant to serve as emergency backups for needed sites that are in danger of closing, or which will be missed dearly if suddenly lost due to hard drive crashes or server failures.

Collection: ArchiveBot: The Archive Team Crowdsourced Crawler

ArchiveBot is an IRC bot designed to automate the archival of smaller websites (e.g. up to a few hundred thousand URLs). You give it a URL to start at, and it grabs all content under that URL, records it in a WARC, and then uploads that WARC to ArchiveTeam servers for eventual injection into the Internet Archive (or other archive sites).

To use ArchiveBot, drop by #archivebot on EFNet. To interact with ArchiveBot, you issue commands by typing it into the channel. Note you will need channel operator permissions in order to issue archiving jobs. The dashboard shows the sites being downloaded currently.

There is a dashboard running for the archivebot process at http://www.archivebot.com.

ArchiveBot's source code can be found at https://github.com/ArchiveTeam/ArchiveBot.

TIMESTAMPS

The Wayback Machine - https://web.archive.org/web/20190504011738/https://github.com/criticalstack/libevhtp

Create extremely-fast and secure embedded HTTP servers with ease. https://criticalstack.com/

https http c library event-driven embedded-c libevent

Find File

Clone or download

NathanFrench [#128 ] fix other (potential) problems related #128

Latest commit 00ccb5c

Mar 10, 2019

Name	Latest commit message	Commit time
Failed to load latest commit information.
.github	Update issues template.	Oct 27, 2017
build	minor updates for pull #33	Sep 20, 2017
cmake	Modernize CMake build	Mar 18, 2018
compat/sys	compat queue.h BSD-only move.	Dec 15, 2011
dist	http access-log API	Aug 7, 2018
examples	check for SO_ATTACH_REUSEPORT_CBPF decl	Feb 7, 2019
include	Release v1.2.18, see ChangeLog for details	Feb 6, 2019
.gitignore	Make github stop bitching about newlines.	Sep 20, 2017
.travis.yml	Added travis.ci gitter webhook.	Apr 15, 2018
.ycm_extra_conf.py	cleanups / added uncrustify configurations	Jul 9, 2018
CMakeLists.txt	Release v1.2.18, see ChangeLog for details	Feb 6, 2019
ChangeLog	Release v1.2.18, see ChangeLog for details	Feb 6, 2019
Doxyfile	update version in Doxyfile	Nov 19, 2017
LICENSE	Update LICENSE	Apr 18, 2018
README.md	update readme / iovec optimizations	Feb 7, 2019
evhtp.c	update readme / iovec optimizations	Feb 7, 2019
evhtp.pc.in	Install into <installdir>/include/evhtp/*.h	Mar 20, 2015
log.c	access-log API finalization / cleanups and overhauls	Aug 9, 2018
numtoa.c	General housecleaning and small bugfixes	Mar 23, 2018
parser.c
refcount.h	[#81 ] use mutex_destroy on refcount.h	Mar 27, 2018
sslutils.c	better get0_notBefore ssl defs	Jan 29, 2019
thread.c	Feature/better thread distribution (#102 )	Jul 10, 2018
zimg_vs_nginx.png	Does image linking work here?	Mar 6, 2015

README.md

	Libevhtp

Required Dependencies

Optional Dependencies

Building

cd build
cmake ..
make
make examples

For Windows MinGW

cmake -G "MSYS Makefiles" -DCMAKE_INCLUDE_PATH=/mingw/include -DCMAKE_LIBRARY_PATH=/mingw/lib -DCMAKE_INSTALL_PREFIX=/mingw .
make

Performance stuff

While we never documented any benchmark publically, the popular open source project ZIMG did a bit of that for us.The ZIMG team decided to move away from NGINX to libevhtp for their software, and the results were pretty outstanding. Here is a graph showing their application under very high load

The X-axis is the number of connections, while the Y-axis is requests per second.

You can read the whole article here: Architecture Design of an Image Server

Slightly outdated (Now faster!)

You can’t perform that action at this time.

Apr	MAY	Jun
	04
2018	2019	2020

criticalstack/libevhtp

Join GitHub today

Clone with HTTPS

Downloading...

Launching GitHub Desktop...