aiter /* 有空再来改~ */

grafana

  • 2022 年 07 月 15 日
  • cs

dashborad

Data sources

Panels

query

  • Query options
  • Query inspector button
  • expressions
  • Basics
  • OPERATORS
  • FUNCTIONS
  • examples
  • how to use if????

prometheus

data types

  • counter
  • gauge
  • histogram
  • summary

micrometer(java base)

  • counter
  • timer
  • gauge

cAdvisor

collect、aggregate、process information about running containers. how to customize?

cs books

  • 2022 年 04 月 20 日
  • cs

books

Modern Operating Systems

Cache

  • Registers
  • Cache
  • Main Memory
  • Magnetic disk
  • Bus

1.5 Operating System Concepts

  • process
  • Address Spaces
  • Files
    • Mount
    • Dictionary
    • Special file
      • block special files
      • character special files
    • pipes
  • Input/Output
  • Protection
    • Owner/Group/EveryOne
  • Shell
  • Ontogeny Recapitulates Phylogeny[?]
  • Large Memories
  • Protection Hardware
  • Disks
  • Virtual Memory

1.6 System Calls

  • System Calls for Process Management
  • System Calls for File Management
  • System Calls for Directory Management
  • Miscellaneous System Calls
  • The Windows Win32 API

1.7 OPERATING SYSTEM STRUCTURE

  • Monolithic Systems
  • Layered Systems
  • Microkernels
  • Client-Server Model
  • Virtual Machines
    • VM/370
    • Virtual Machines Rediscovered
    • The Java Virtual Machine
  • Exokernels

1.8 THE WORLD ACCORDING TO C

  • The C Language
  • Header Files
  • Large Programming Projects
  • The Model of Run Time

1.9 RESEARCH ON OPERATING SYSTEMS

1.10 OUTLINE OF THE REST OF THIS BOOK

1.11 METRIC UNITS

1.12 SUMMARY

PROCESSES AND THREADS

2.1 PROCESSES 2.1.1 The Process Model 2.1.2 Process Creation 2.1.3 Process Termination 2.1.4 Process Hierarchies 2.1.5 Process States 2.1.6 Implementation of Processes 2.1.7 Modeling Multiprogramming

2.2 THREADS

2.2.1 Thread Usage

2.2.2 The Classical Thread Model

2.2.3 POSIX Threads

2.2.4 Implementing Threads in User Space

2.2.8 Pop-Up Threads

2.2.9 Making Single-Threaded Code Multithreaded

2.3 INTERPROCESS COMMUNICATION

  • 2.3.1 Race Conditions
  • 2.3.2 Critical Regions
  • 2.3.3 Mutual Exclusion with Busy Waiting
  • Disabling Interrupts
  • Lock Variables
  • Strict Alternation
  • Peterson’s Solution
  • The TSL Instruction
  • 2.3.4 Sleep and Wakeup
  • The Producer-Consumer Problem

2.3.5 Semaphores

  • Solving the Producer-Consumer Problem Using Semaphores
  • The Producer-Consumer Problem with Message Passing

2.3.6 Mutexes

  • Futexes
  • Mutexes in Pthreads

2.3.7 Monitors

2.3.8 Message Passing 2.3.9 Barriers 2.3.10 Avoiding Locks: Read-Copy-Update

2.4 SCHEDULING

  • scheduler
  • scheduling algorithm

2.4.1 Introduction to Scheduling Process Behavior When to Schedule Categories of Scheduling Algorithms Scheduling Algorithm Goals

  • All systems
  • Batch systems
  • Interactive systems
  • Real-time systems

2.4.2 Scheduling in Batch Systems

  • First-Come, First-Served
  • Shortest Job First
  • Shortest Remaining Time Next

2.4.3 Scheduling in Interactive Systems

  • Round-Robin Scheduling
  • Priority Scheduling
  • Multiple Queues
  • Shortest Process Next
  • Guaranteed Scheduling
  • Lottery Scheduling
  • Fair-Share Scheduling

2.4.4 Scheduling in Real-Time Systems 2.4.5 Policy Versus Mechanism 2.4.6 Thread Scheduling

2.5 CLASSICAL IPC PROBLEMS 2.5.1 The Dining Philosophers Problem 2.5.2 The Readers and Writers Problem

2.6 RESEARCH ON PROCESSES AND THREADS 2.7 SUMMARY

MEMORY MANAGEMENT

3.1 NO MEMORY ABSTRACTION

  • Running Multiple Programs Without a Memory Abstraction

3.2 A MEMORY ABSTRACTION: ADDRESS SPACES 3.2.1 The Notion of an Address Space

Base and Limit Registers

3.2.2 Swapping 3.2.3 Managing Free Memory Memory Management with Bitmaps Memory Management with Linked Lists

3.3 VIRTUAL MEMORY 3.3.1 Paging 3.3.2 Page Tables

Virtual Memory

  • Design Issues for Message-Passing Systems

  • 操作系统 - 精髓与设计原理(第八版)
    • Operating Systems - Internals and Design Principles, Eighth Edition

  • Modern Operating Systems – by Andrew Tanenbaum and Herbert Bos

  • 《Unix高级环境编程》
  • 《Unix网络编程》
  • 《TCP/IP详解 卷I协议》

《TCP/IP详解 卷I协议》

  • 概述
  • 链路层
    • SLIP
    • PPP: 点对点协议
    • 环回接口
    • 最大传输单元MTU
  • IP: 网际协议
    • ip header
  • TCP
    • 1.4. Interfaces ： on one side to user or application processes and on the other side to a lower level protocol such as Internet Protocol.
    • Basic Data Transfer
    • Reliability: ACK & the sequence numbers
    • Flow Control
    • SYN FIN ACK RST
    • Multiplexing
    • Connections
    • Precedence and Security
    • 2.1. Elements of the Internetwork System
    • 2.2. Model of Operation
    • 2.3. The Host Environment
  • UDP

focus on military computer communication requirements

  • https://pdos.csail.mit.edu/6.828/2020/schedule.html

  • https://techviewleo.com/best-books-to-learn-operating-systems/

  • https://ocw.mit.edu/about/

  • 算法
  • 算法图解
  • 算法导论 - 理论加持

  • 编程珠玑 - 思维改善

  • List of Algotithms
  • Data Structure Visualizations

web3.0

redis

  • k-V(v的多种数据结构)
  • intset
  • ttl
  • expire
  • sync/pync
  • Sentinel
  • pubsub
  • streams
  • Bitmaps
  • HyperLogLog

client

  • java
    • jedis
    • lettuce
    • jedisson
  • netty

higress VRRP

negotiate making plans

registry&repository container log event json ref fastjson/jackson

history qin dynasty

ioc

pod selector

Heuristic scheduling: This approach uses rules of thumb to allocate resources to tasks. Heuristic scheduling is often fast and easy to implement, but it may not always find the optimal solution.

Manage data in Docker

tensorflow

chatGPT/Bard/百度文心

AIGC

DALL-E

AIGC智能创造时代

API/finetune

load balance *2..

其他书籍

outliers 异类

三体

给我三分钟光明

too slow read history

地理书

概率统计

  • 函数
  • 图形

prompt

kernel

history: han

history: qin

  • 苏秦/张仪

LLM

  • vLLM

references

Beijing 2022 winter olympics

Beijing 2022

2.4-2.20

Curling 冰壶

Figure Skating 花样滑冰

HANYU Yuzuru CHEN Nathan Alysa Liu, Mariah Bell have dream Olympic performances in women’s free skate

Speed Skating 速滑

Short Track Speed Skating

Dajing WU Mixed Team Relay Ziwei REN Men’s 1000m & Mixed Team Relay

Ice Hockey 冰球

snow

Alpine Skiing 高山滑雪

  • Giant Slalom
  • Downhill

Cross-Country Skiing(CCS) 越野滑雪

Norway: 3 Gold Medals

Nordic Combined(NCB) 北欧两项(指越野滑雪和跳台滑雪)

Biathlon(BTH) 冬季两项(越野滑雪和步枪射击)

Norway: 2 Gold Medals

  • Pursuit

Luge(LUG) 雪橇

Germany: 4 Gold Medals

Skeleton(SKN) 钢架雪车

Bobsleigh 雪车

Freestyle Skiing 自由式滑雪

谷爱凌 - Ailing Eileen GU Women’s Freeski Big Air(大跳台) Women’s Freeski Slopestyle(坡面障碍技巧) Women’s Freeski Halfpipe(U型场地技巧)

  • Halfpipe

  • aerials

Xu Mengtao wins emotional gold in Beijing 2022 freestyle skiing women’s aerials Su Yiming’s double 1800s seal Team China gold in men’s snowboard big air Ailing Eileen GU wins gold in Women’s Freeski Halfpipe

Ski Jumping 跳台滑雪

Snowboard 单板滑雪

Opening/Closing Ceremony

2022.2.4/2022.2.20

References

Shougang Park

rtmp,hls

RTMP(Real-Time Messaging Protocol)

  • works on top of TCP and uses port number 1935 by default
  • RTMPS, which is RTMP over a TSL/SSL connection

RTMP,HLS, and WebRTC

What is a Streaming Protocol? Video Streaming Protocol

Video->chunks->transport->reassemble

Steaming Protocols

What is RTMP? RTMP

  • streaming protocol
  • low latency streaming
  • RTMP has taken a new role in live streaming. Ingesting media from the encoder or other source to a video streaming platform.
  • the most accessible and affordable option since it works with most modern encoders, including many free encoding software.
  • ❗️不兼容很多的视频播放器(not compatible with more modern video players)
  • ✅ very effective in its ingestion role

What is HLS? HLS

  • developed by Apple from streaming with an HTML5 video player
  • RTMP delivery to the Adobe Flash player —> HLS delivery to the HTML5 video player
  • HLS is very secure
  • produces high-quality steams
  • supports adaptive bitrate steaming (at the professional broadcasting level)
  • both delivery(更多场景) and ingest(和编码器encoders的兼容还不太好)
  • ❗️latency of 15-30 seconds (时延比较高)

What is WebRTC? WebRTC

  • rather than a protocol
  • was created to support web conferencing and VoIP
  • make peer-to-peer streaming with real-time latency possible
  • adaptive bitrate streaming

WebRTC Tutorial

  • Audience
  • Prerequisites
  • Basic Scheme
  • Media Capture
  • codec: H.264, iSAC, Opus and VP8
  • Transportation Layer
  • Session Management
  • Browser Compatibility

Comaring RTMP vs. HLS vs. WebRTC

  • HLS delivery with RTMP ingest. Low latency, ultra-compatibility, affordability
  • HLS delivery + RTMP ingest
  • HLS delivery + HLS ingest(编码器支持的少)
  • WebRTC: more and more popular. 主要的限制：编码器支持的少
  • professional broadcasting level比较低(不能选择bitrate?)

WebSocket

  • over HTTP
  • ws/wss

container format

Design Philosophy

there should be minimal framing It is expected that metadata would be layered on top of WebSocket by the application layer, in the same way that metadata is layered on top of TCP by the application layer (e.g., HTTP).

  • adds a web origin-based security model for browsers
  • adds an addressing and protocol naming mechanism to support multiple services on one port and multiple host names on one IP address
  • layers a framing mechanism on top of TCP to get back to the IP packet mechanism that TCP is built on, but without length limits
  • includes an additional closing handshake in-band that is designed to work in the presence of proxies and other intermediaries

Security Model

Relationship to TCP and HTTP

Security considerations

Proxy traversal

Establishing a Connection

Subprotocols Using the WebSocket Protocol

references

https://www.tutorialspoint.com/webrtc/webrtc_overview.htm https://en.wikipedia.org/wiki/Dynamic_Adaptive_Streaming_over_HTTP https://www.ibm.com/ibm/history/exhibits/builders/builders_bloch.html https://www.cgl.ucsf.edu/Outreach/pc204/NoSilverBullet.html?spm=ata.21736010.0.0.887316fdudx1ZT https://architecturenotes.co/fallacies-of-distributed-systems/

ccf 中国计算机学会推荐国际学术会议和期刊目录

  • 2021 年 11 月 26 日
  • ccf

CCF推荐国际学术刊物目录

  • 主要是ACM 和 IEEE

计算机体系结构/并行与分布计算/存储系统

算机网络

网络与信息安全

软件工程/系统软件/程序设计语言

数据库/数据挖掘/内容检索

计算机科学理论

计算机图形学与多媒体

人工智能

人机交互与普适计算

交叉/综合/新兴

CCF推荐中文科技期刊目录

如何找到优秀的论文

  • 通过收录列表，被收录，说明被认可
  • 通过google Scholar 查找，并查看被引用数(Cited by..)
  • 关注推荐列表？

几个主要的出版社？

  • ACM
  • IEEE
  • USENIX
  • Springer
  • Elsevier
  • SIAM
  • INFORMS
  • AAAI
  • MIT Press

USENIX

USENIX（读做use-nix）是一个支持操作系统研究的协会

  • OSDI: Symposium on Operating Systems Design and Implementation 操作系统顶会
  • NSDI: Symposium on Networked Systems Design and Implementation 网络系统顶会
  • ATC : Annual Technical Conference
  • FAST : File and Storage Technologies 存储顶会

ACM

Association for Computing Machine 国际计算机协会 CCF： China Computer Federation 中国计算机学会

SIGPLAN

Special Interest Group on Programming Languages

  • focusing on design, implementation, practice, and theory
  • Its members are programming language developers, educators, implementers, researchers, theoreticians, and users.

PPoPP:Principles & Practice of Parallel Programming

SIGCOMM

Special Interest Group on Data Communication SIGCOMM是ACM组织在通信网络领域的旗舰型会议，也是国际通信网络领域的顶尖会议，由ACM SIGCOMM组织举办。

ACM有下属37个专业组织SIGs（Special Interest Group）

INFOCOMM

Aritficial Intelligence

Neural Informaion Proccessing Systems

NeurIPS 2021

[5]

reference

1. ccf Academic Evaluation 2. ACM SIGs 3. sigplan.org 4. PPoPP SIGPLAN 5. NeurIPS 2021