{ "name": "Hacker news job listing scraper and parser", "nodes": [ { "id": "f7cdb3ee-9bb0-4006-829a-d4ce797191d5", "name": "When clicking ‘Test workflow’", "type": "n8n-nodes-base.manualTrigger", "position": [ -20, -220 ] }, { "id": "0475e25d-9bf4-450d-abd3-a04608a438a4", "name": "Sticky Note", "type": "n8n-nodes-base.stickyNote", "position": [ 60, -620 ], "parameters": { "width": 460, "height": 340, "content": "## Go to https://hn.algolia.com\n- filter by \"Ask HN: Who is hiring?\" (important with quotes for full match)\n- sort by date\n- Chrome Network Tab > find API call > click \"Copy as cURL\"\n- n8n HTTP node -" } }, { "id": "a686852b-ff84-430b-92bb-ce02a6808e19", "name": "Split Out", "type": "n8n-nodes-base.splitOut", "position": [ 400, -220 ] }, { "id": "cdaaa738-d561-4fa0-b2c7-8ea9e6778eb1", "name": "Sticky Note1", "type": "n8n-nodes-base.stickyNote", "position": [ 1260, -620 ], "parameters": { "width": 500, "height": 340, "content": "## Go to HN API \nhttps://github.com/HackerNews/API\n\nWe'll need following endpoints: \n- For example, a story: https://hacker-news.firebaseio.com/v0/item/8863.json?print=pretty\n- comment: https://hacker" } }, { "id": "4f353598-9e32-4be4-9e7b-c89cc05305fd", "name": "OpenAI Chat Model", "type": "@n8n/n8n-nodes-langchain.lmChatOpenAi", "position": [ 2680, -20 ] }, { "id": "5bd0d7cc-497a-497c-aa4c-589d9ceeca14", "name": "Structured Output Parser", "type": "@n8n/n8n-nodes-langchain.outputParserStructured", "position": [ 2840, -20 ] }, { "id": "b84ca004-6f3b-4577-8910-61b8584b161d", "name": "Search for Who is hiring posts", "type": "n8n-nodes-base.httpRequest", "position": [ 200, -220 ] }, { "id": "205e66f6-cd6b-4cfd-a6ec-2226c35ddaac", "name": "Get relevant data", "type": "n8n-nodes-base.set", "position": [ 700, -220 ] }, { "id": "16bc5628-8a29-4eac-8be9-b4e9da802e1e", "name": "Get latest post", "type": "n8n-nodes-base.filter", "position": [ 900, -220 ] }, { "id": "92e1ef74-5ae1-4195-840b-115184db464f", "name": "Split out children (jobs)", "type": "n8n-nodes-base.splitOut", "position": [ 1460, -220 ] }, { "id": "d0836aae-b98a-497f-a6f7-0ad563c262a0", "name": "Trun into structured data", "type": "@n8n/n8n-nodes-langchain.chainLlm", "position": [ 2600, -220 ] }, { "id": "fd818a93-627c-435d-91ba-5d759d5a9004", "name": "Sticky Note2", "type": "n8n-nodes-base.stickyNote", "position": [ 2600, -620 ], "parameters": { "width": 840, "height": 340, "content": "## Data Structure\n\nWe use Openai GPT-4o-mini to transform the raw data in a unified data structure. Feel free to change this.\n\n```json\n{\n \"company\": \"Name of the hiring company\",\n \"title\": \"Job titl" } }, { "id": "b70c5578-5b81-467a-8ac2-65374e4e52f3", "name": "Extract text", "type": "n8n-nodes-base.set", "position": [ 1860, -220 ] }, { "id": "acb68d88-9417-42e9-9bcc-7c2fa95c4afd", "name": "Clean text", "type": "n8n-nodes-base.code", "position": [ 2060, -220 ] }, { "id": "a0727b55-565d-47c0-9ab5-0f001f4b9941", "name": "Limit for testing (optional)", "type": "n8n-nodes-base.limit", "position": [ 2280, -220 ] }, { "id": "650baf5e-c2ac-443d-8a2b-6df89717186f", "name": "Sticky Note3", "type": "n8n-nodes-base.stickyNote", "position": [ 580, -620 ], "parameters": { "width": 540, "height": 340, "content": "## Clean the result \n\n```json\n{\n\"title\": \"Ask HN: Who is hiring? (February 2025)\",\n\"createdAt\": \"2025-02-03T16:00:43Z\",\n\"updatedAt\": \"2025-02-17T08:35:44Z\",\n\"storyId\": \"42919502\"\n},\n{\n\"title\": \"Ask HN" } }, { "id": "1ca5c39f-f21d-455a-b63a-702e7e3ba02b", "name": "Write results to airtable", "type": "n8n-nodes-base.airtable", "position": [ 3040, -220 ] }, { "id": "d71fa024-86a0-4f74-b033-1f755574080c", "name": "Sticky Note4", "type": "n8n-nodes-base.stickyNote", "position": [ -520, -300 ], "parameters": { "width": 380, "height": 500, "content": "## Hacker News - Who is Hiring Scrape\n\nIn this template we setup a scraper for the monthly HN Who is Hiring post. This way we can scrape the data and transform it to a common data strcutre.\n\nFirst we " } }, { "id": "7466fb0c-9f0c-4adf-a6de-b2cf09032719", "name": "HI API: Get the individual job post", "type": "n8n-nodes-base.httpRequest", "position": [ 1660, -220 ] }, { "id": "184abccf-5838-49bf-9922-e0300c6b145e", "name": "HN API: Get Main Post", "type": "n8n-nodes-base.httpRequest", "position": [ 1260, -220 ] } ], "connections": { "Split Out": { "main": [ [ { "node": "Get relevant data", "type": "main", "index": 0 } ] ] }, "Clean text": { "main": [ [ { "node": "Limit for testing (optional)", "type": "main", "index": 0 } ] ] }, "Extract text": { "main": [ [ { "node": "Clean text", "type": "main", "index": 0 } ] ] }, "Get latest post": { "main": [ [ { "node": "HN API: Get Main Post", "type": "main", "index": 0 } ] ] }, "Get relevant data": { "main": [ [ { "node": "Get latest post", "type": "main", "index": 0 } ] ] }, "OpenAI Chat Model": { "ai_languageModel": [ [ { "node": "Trun into structured data", "type": "ai_languageModel", "index": 0 } ] ] }, "HN API: Get Main Post": { "main": [ [ { "node": "Split out children (jobs)", "type": "main", "index": 0 } ] ] }, "Structured Output Parser": { "ai_outputParser": [ [ { "node": "Trun into structured data", "type": "ai_outputParser", "index": 0 } ] ] }, "Split out children (jobs)": { "main": [ [ { "node": "HI API: Get the individual job post", "type": "main", "index": 0 } ] ] }, "Trun into structured data": { "main": [ [ { "node": "Write results to airtable", "type": "main", "index": 0 } ] ] }, "Limit for testing (optional)": { "main": [ [ { "node": "Trun into structured data", "type": "main", "index": 0 } ] ] }, "Search for Who is hiring posts": { "main": [ [ { "node": "Split Out", "type": "main", "index": 0 } ] ] }, "When clicking ‘Test workflow’": { "main": [ [ { "node": "Search for Who is hiring posts", "type": "main", "index": 0 } ] ] }, "HI API: Get the individual job post": { "main": [ [ { "node": "Extract text", "type": "main", "index": 0 } ] ] } } }