Handle None span context in the span processor and pin tokenizers version for anthropic tests on Python 3.8

Handle None span context in the span processor and pin tokenizers version for anthropic tests on Python 3.8 #18982