Python定时从Mysql提取数据存入Redis的实现

Python定时从定时从Mysql提取数据存入提取数据存入Redis的实现的实现

主要介绍了Python定时从Mysql提取数据存入Redis的实现，具有很好的参考价值，希望对大家有所帮助。一起跟随小编过来看看吧

设计思路：设计思路：

1.程序一旦run起来，python会把mysql中最近一段时间的数据全部提取出来

2.然后实例化redis类，将数据简单解析后逐条传入redis队列

3.定时器设计每天凌晨12点开始跑

ps：redis是个内存数据库，做后台消息队列的缓存时有很大的用处，有兴趣的小伙伴可以去查看相关的文档。

# -*- coding:utf-8 -*-

import redis

# get the data from mysql

class FromSql(object):

def __init__(self, conn):

self.conn = conn

def acquire(self):

cursor = self.conn.cursor()

try:

sql = "SELECT * FROM test WHERE TO_DAYS(NOW()) - TO_DAYS(t) <= 1"

cursor.execute(sql)

return copy_rs

except Exception as e:

print("The error: %s" % e)

class RedisQueue(object):

def __init__(self, name, namespace='queue', **redis_kwargs):

"""The default connection parameters are: host='localhost', port=6379, db=0"""

self.__db= redis.Redis(**redis_kwargs)

self.key = '%s:%s' %(namespace, name)

def qsize(self):

return self.__db.llen(self.key)

item = self.__db.lpop(self.key)

if item:

item = item[1]

return item

def get_nowait(self):

return self.get(False)

if __name__ == "__main__":

# connect mysqldb

conn_sql = MySQLdb.connect(

host = '127.0.0.1',

def job_for_redis():

get_data = FromSql(conn_sql)

data = get_data.acquire()

q = RedisQueue('test',host='localhost', port=6379, db=0)

for single_data in data:

for meta_data in single_data:

q.put(meta_data)

print(meta_data)

print("All data had been inserted.")

"""

while True:

schedule.run_pending()

time.sleep(1)

"""

补充知识：补充知识：python定时获取汇率存入数据库定时获取汇率存入数据库

python定时任务：