# Access Logs as streams

**URL:** <https://community.cratedb.com/t/access-logs-as-streams/49>\
**Category:** 3rd Party Tools\
**Created:** [November 6, 2018, 2:40pm UTC](https://community.cratedb.com/t/access-logs-as-streams/49 "2018-11-06T14:40:36Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![roman](https://sea2.discourse-cdn.com/flex020/user_avatar/community.cratedb.com/roman/32/36_2.png) [@roman](https://community.cratedb.com/u/roman)\
**Post date:** [November 6, 2018, 2:40pm UTC](https://community.cratedb.com/t/access-logs-as-streams/49/1 "2018-11-06T14:40:36Z")

</div>

Hi,

We have an application that runs on dozens of servers and each instance generate huge logs. We would like to access logs as streams and parse it and store in crateDB. I want to know the following…

1. How to access logs as streams from log files?.Please suggest any tool
2. How to store it in CrateDB…. (bulk insert is the way to go?, Please suggest I’m using python client)  
Thanks & appreciate

---

<div class="post-metadata">

**Author:** ![roman](https://sea2.discourse-cdn.com/flex020/user_avatar/community.cratedb.com/roman/32/36_2.png) [@roman](https://community.cratedb.com/u/roman)\
**Post date:** [November 6, 2018, 2:40pm UTC](https://community.cratedb.com/t/access-logs-as-streams/49/2 "2018-11-06T14:40:59Z")

</div>

Regarding 1)  
I think you can use any external stream parsing tool once you got the data from the files - Maybe Kafka or Flink?

Regarding 2)  
Did you check the documentation for python usage: [https://crate.io/docs/clients/python/en/latest/query.html#inserting-data](https://crate.io/docs/clients/python/en/latest/query.html#inserting-data)
