❓ Question: How to Extract any Properties (outerHTML, outerText, etc) of a element?

[thuddo23]

Hi all,

I'm trying to extract structured data from an HTML table on an Amazon product page. The table has the following CSS selector:

#productDetails_techSpec_section_1

I want my schema like this:

def get_product_detail_schema():
    return {
        "name": "Amazon Product Detail",
        "baseSelector": "#dp-container",
        "fields": [
            {
                "name": "Table Description",
                "selector": "#productDetails_techSpec_section_1",
                "type": "outerHTML",
                "default": ""
            }
        ]
    }

🔍 Question:
Please instruct me crawl the outerHTML or any properties of element.

[hafezparast]

The supported field types for JsonCssExtractionStrategy are: "text", "attribute", "html", "regex", "nested", and "list".

For your use case, use "type": "html" — this returns the full outer HTML of the matched element (equivalent to outerHTML in JavaScript).

Here's your corrected schema:

def get_product_detail_schema():
    return {
        "name": "Amazon Product Detail",
        "baseSelector": "#dp-container",
        "fields": [
            {
                "name": "Table Description",
                "selector": "#productDetails_techSpec_section_1",
                "type": "html",
                "default": ""
            }
        ]
    }

You can also chain types as a pipeline — for example "type": ["html", "regex"] to get HTML first and then apply a regex on it. And if you just want the text content (like innerText), use "type": "text".