Web Crawler Demo
in blog on speech-recognition, Annyang, javascript
A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering). wiki
Web Crawler
환경구성
| 구분 | 구성 | 비고 |
|---|---|---|
| 수집차트 | 멜론일간차트 | https://www.melon.com/chart/day/index.htm |
| 웹크롤러 | heroku/node.js | https://get-chart.herokuapp.com/ |
| 클라이언트 | html5/jQuery | http://127.0.0.1:4000/blog/2020-09-12-melon-chart/ |
node.js CORS (cross origin resource sharing) 문제 해결방법
방안 해결방안 코드 1 Access-Control-Allow-Origin response header 추가 res.header("Access-Control-Allow-Origin", "*");2 CORS middleware 추가 app.use(cors());- Access-Control-Allow-Origin response header 추가
app.get('/data', (req, res) => { res.header("Access-Control-Allow-Origin", "*"); res.send(data); }); - CORS middleware 추가
const express = require('express'); const cors = require('cors'); const app = express(); const corsOptions = { origin: 'http://localhost:3000', credentials: true, }; app.use(cors(corsOptions));
Chart Crawler
https://get-chart.herokuapp.com/
