aboutsummaryrefslogtreecommitdiffstatshomepage
path: root/tokenize.c
AgeCommit message (Expand)AuthorFilesLines
2022-06-09allow show_token() on TOKEN_ZERO_IDENTLuc Van Oostenryck1-0/+2
2020-08-09Merge branch 'empty-char' into nextLuc Van Oostenryck1-6/+1
2020-07-29fix stream_prev() for invalid (negative) streamLuc Van Oostenryck1-1/+4
2020-07-22add position to struct streamLuc Van Oostenryck1-5/+8
2020-07-22delay 'empty character constant' warning to phase 5Luc Van Oostenryck1-6/+1
2020-07-19prepend diagnostics with source's path and include chainLuc Van Oostenryck1-3/+11
2020-05-27add an option to suppress warning 'no newline at EOF'Luc Van Oostenryck1-1/+1
2018-12-09as-name: add and use show_as()Luc Van Oostenryck1-2/+2
2018-12-09multi-buffer for identsLuc Van Oostenryck1-1/+5
2018-12-09don't allow newlines inside string literalsLuc Van Oostenryck1-3/+3
2018-11-02tokenize: check show_string() for NULL pointerBen Dooks1-1/+1
2018-06-08utils: convert alloc + copy to {mem,str}dup_alloc()Luc Van Oostenryck1-7/+2
2018-06-01give a position to end-of-inputLuc Van Oostenryck1-0/+1
2017-09-19cclass: cleanupLuc Van Oostenryck1-18/+6
2017-09-19cclass: char is wide enoughLuc Van Oostenryck1-1/+1
2017-07-04Let create_symbol check for previous same symbolChristopher Li1-2/+2
2017-02-13remove 'Escape' from token character classLuc Van Oostenryck1-14/+11
2017-02-13warn on unknown escapes after preprocessingLuc Van Oostenryck1-3/+0
2013-11-29sparse: Relicense under the MIT licenseFranz Schrober1-1/+17
2013-02-25Get rid of gcc warning about enum valuesChristopher Li1-4/+4
2013-02-12switch to delayed handling of escape sequencesAl Viro1-156/+175
2013-02-12massage handling of wide string literals/character constants in tokenizerAl Viro1-8/+13
2012-04-13Fix tab handling in nextchar_slow()Al Viro1-23/+26
2011-04-19Add new streams to a hash-list based on their namesLinus Torvalds1-1/+24
2011-01-03Fix tokenizer for octal escape sequencesNamhyung Kim1-1/+1
2010-06-17Parsing wide char stringChristopher Li1-6/+11
2010-04-08Allow parsing L'\0'Christopher Li1-4/+8
2009-08-11show_token: handle TOKEN_UNTAINT and TOKEN_ARG_COUNT typesReinhard Tartler1-2/+11
2009-01-02Add -ftabstop=WIDTHHannes Eder1-2/+3
2008-12-18Remove pre_bufferChristopher Li1-10/+11
2008-07-14Fix use of invalid file descriptorVegard Nossum1-0/+2
2007-07-29tokenize.c: Simplify drop_stream_eoln().ricknu-0@student.ltu.se1-7/+6
2007-07-24tokenize.c: Replace handwritten strncmp with existing function.ricknu-0@student.ltu.se1-10/+3
2007-06-09'\?' is a valid escape character defined by ANSI C. Its value is '?'.Michael Stefaniuc1-0/+2
2007-05-01combinations string clean upChristopher Li1-3/+2
2007-03-09Fix typos in commentsJosh Triplett1-2/+2
2006-10-24switch to hash-based get_one_special()Al Viro1-12/+66
2005-11-16Re-name "error()" function to "sparse_error()"Linus Torvalds1-2/+2
2005-09-22[PATCH] replaced warnings with errors.Mitesh Shah1-1/+1
2005-08-03Update the calling interface to "sparse()".Linus Torvalds1-3/+3
2005-04-07[PATCH] static declearChristopher Li1-3/+3
2005-04-07[PATCH] make include path handling gcc compatibleSam Ravnborg1-0/+1
2005-04-07Add "stream_name()" helper function, and use it.Linus Torvalds1-2/+9
2005-04-07Remove stat-based file identity tests.Linus Torvalds1-16/+0
2005-04-07Split out the blob allocator from lib.c into allocate.c.Linus Torvalds1-0/+1
2005-04-07Duh. Fix micro-optimization.Linus Torvalds1-1/+2
2005-04-07Optimize "create_hashed_ident()".Linus Torvalds1-1/+11
2005-04-07Avoid costly bitfield updates in tokenization.Linus Torvalds1-56/+48
2005-04-07Uninline "nextchar()", and optimize.Linus Torvalds1-4/+10
2005-04-07Prevent buffer overrun in show_string.welinder@troll.com1-1/+1
2005-04-07Use proper ptrdiff_t printf argument.Linus Torvalds1-1/+1
2005-04-07Allow longer number tokens (up to 4095 characters) and catchwelinder@troll.com1-4/+15
2005-04-07Increase identifier hash sizeLinus Torvalds1-2/+3
2005-04-07Handle bad strings gracefully. Linus Torvalds1-0/+2
2005-04-07Add system-specific compatibility functions to makeLinus Torvalds1-2/+2
2005-04-07Many files:welinder@darter.rentec.com1-12/+12
2005-04-07[PATCH] make preprocesser command a symbolChristopher Li1-1/+1
2005-04-07Make "next_path" be per-stream for better "include_next".Linus Torvalds1-3/+4
2005-04-07pre-process.c:welinder@troll.com1-11/+13
2005-04-07[PATCH] teach show_special() to handle tokens introduced by evaluate_comparis...Alexander Viro1-1/+1
2005-04-07C99 says strings should be up to 4095 bytes.Linus Torvalds1-1/+1
2005-04-07Don't allow string concatenation to overflow MAX_STRING.Linus Torvalds1-2/+0
2005-04-07[PATCH] speed up (and fix corner case in) tokenizerAlexander Viro1-44/+66
2005-04-07Make sparse accept strings up to 2kB in length.Linus Torvalds1-7/+9
2005-04-07[PATCH] trivial optimization for tokenizerAlexander Viro1-10/+12
2005-04-07[PATCH] line-splicing fixes in sparseAlexander Viro1-21/+93
2005-04-07[PATCH] comments handling fix in sparseAlexander Viro1-1/+6
2005-04-07Shrink "struct token" by moving "noexpand" into the position flags.Linus Torvalds1-0/+1
2005-04-07[PATCH] Fix preprocessor expansion anti-recursion properlyAlexander Viro1-0/+1
2005-04-07Remove TOKEN_FP vs TOKEN_INTEGER distinction, and make numbers beLinus Torvalds1-105/+42
2005-04-07Start fixing pp-number tokenization.Linus Torvalds1-4/+7
2005-04-07Allow DOS-style '\r' characters in the input files.Linus Torvalds1-1/+15
2005-04-07Update copyright notices to reflect the fact that TransmetaLinus Torvalds1-0/+1
2005-04-07Make the tokenizer recognize FP tokens, even if we don'tLinus Torvalds1-1/+44
2005-04-07[PATCH] escape character extensionDave Olien1-2/+23
2005-04-07Start updating the copyright license comments to the OSL,Linus Torvalds1-1/+3
2005-04-07Change the copyright to Transmeta Corp, that's likely to beLinus Torvalds1-1/+1
2005-04-07Start doing constant strings right: do proper concatenation of strings,Linus Torvalds1-15/+19
2005-04-07Introduce a "struct position", and have the different types referLinus Torvalds1-44/+41
2005-04-07Add support for tokenizing a pre-allocated string instead of a file.Linus Torvalds1-35/+61
2005-04-07Always accept \' and \" token escapes in strings/char constants,Linus Torvalds1-0/+4
2005-04-07Add copyright statements and file comments. Add a FAQ, README, andLinus Torvalds1-5/+3
2005-04-07Parse __alignof__ (although right now it ends up parsing as aLinus Torvalds1-5/+1
2005-04-07Avoid re-tokenizing header files that are protected byLinus Torvalds1-8/+24
2005-04-07Make the tokenizer insert begin/end tokens at stream boundaries,Linus Torvalds1-8/+41
2005-04-07Re-name the "action" thing as something saner - it's now a "stream".Linus Torvalds1-126/+128
2005-04-07Tokenization drops whitespace, but there is one area where it isLinus Torvalds1-1/+10
2005-04-07Make preprocessor errors more readable, to help adding theLinus Torvalds1-0/+3
2005-04-07Move some common parsing routines to "lib", so thattheLinus Torvalds1-29/+3
2005-04-07When tokenizing integers, make the first character in the tokenLinus Torvalds1-3/+16
2005-04-07Teach the preprocessing pass to handle 'include' and Linus Torvalds1-4/+6
2005-04-07Preprocessor symbol handling: handle simple cases of #define andLinus Torvalds1-0/+1
2005-04-07Add initial preprocessor pass (doesn't actually do much)Linus Torvalds1-6/+12
2005-04-07Implement space-efficient allocator for small data structures. WeLinus Torvalds1-76/+72
2005-04-07Make 'struct token' smaller (it's way too common). Linus Torvalds1-4/+14
2005-04-07Tokenize integer constants with "u" and "l" specifiers (drop them for now).Linus Torvalds1-11/+17
2005-04-07Add allocators for statisticsLinus Torvalds1-10/+4
2005-04-07Fix up confusion between different typedefs and namespaces.Linus Torvalds1-6/+9
2005-04-07Make lexing tester print out string constants properly.Linus Torvalds1-3/+4
2005-04-07Fix warning, missed return value, and add 'struct', 'union' andLinus Torvalds1-1/+1
2005-04-07Initialize 'struct', 'union' and 'enum' built-ins.Linus Torvalds1-24/+44
2005-04-07Add more type parsing: function and array declarators, functionLinus Torvalds1-0/+2
2005-04-07Start handling minimal semantic information, needed for types.Linus Torvalds1-28/+53
2005-04-07Mark local parsing functions 'static'.Linus Torvalds1-1/+1
2005-04-07Add simple recursive-descent C expression parsing (but we only do theLinus Torvalds1-23/+90
2005-04-07Yaah. I'm a retard, but I want to at least try to see how hard it isLinus Torvalds1-0/+559