--- title: pubmed keywords: fastai sidebar: home_sidebar summary: "API details." ---
URL = 'https://www.ncbi.nlm.nih.gov'
user_agent = [
"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/22.0.1207.1 Safari/537.1",
"Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:55.0) Gecko/20100101 Firefox/55.0",
"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.101 Safari/537.36",
"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/22.0.1207.1 Safari/537.1",
"Mozilla/5.0 (X11; CrOS i686 2268.111.0) AppleWebKit/536.11 (KHTML, like Gecko) Chrome/20.0.1132.57 Safari/536.11",
"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/536.6 (KHTML, like Gecko) Chrome/20.0.1092.0 Safari/536.6",
"Mozilla/5.0 (Windows NT 6.2) AppleWebKit/536.6 (KHTML, like Gecko) Chrome/20.0.1090.0 Safari/536.6",
"Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/<IP_ADDRESS> Safari/537.1",
"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/536.5 (KHTML, like Gecko) Chrome/19.0.1084.9 Safari/536.5",
"Mozilla/5.0 (Windows NT 6.0) AppleWebKit/536.5 (KHTML, like Gecko) Chrome/19.0.1084.36 Safari/536.5",
"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1063.0 Safari/536.3",
"Mozilla/5.0 (Windows NT 5.1) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1063.0 Safari/536.3",
"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_0) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1063.0 Safari/536.3",
"Mozilla/5.0 (Windows NT 6.2) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1062.0 Safari/536.3",
"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1062.0 Safari/536.3",
"Mozilla/5.0 (Windows NT 6.2) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1061.1 Safari/536.3",
"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1061.1 Safari/536.3",
"Mozilla/5.0 (Windows NT 6.1) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1061.1 Safari/536.3",
"Mozilla/5.0 (Windows NT 6.2) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1061.0 Safari/536.3",
"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/535.24 (KHTML, like Gecko) Chrome/19.0.1055.1 Safari/535.24",
"Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/535.24 (KHTML, like Gecko) Chrome/19.0.1055.1 Safari/535.24"
]
Start WebDriver
options = Options()
options.add_argument("--headless")
options.add_argument("--no-sandbox")
browser = webdriver.Chrome(options=options, executable_path='./chromedriver')
browser.page_source
''
Create MongoDB container from image and expose to localhost:27017
MONGO_HOST = 'mongodb://localhost:27017'
client = MongoClient(MONGO_HOST)
# create or load pubmed database
db = client.PubMed
get_max_pages
[source]
get_max_pages
(keywords
)
search_keywords = ['electroencephalogram',
'near infrared spectroscopy',
'transcranial electrical stimulation',
'transcranial magnetic stimulation',
'cognitive assessment',
'magnetic resonance']
[get_max_pages(kw) for kw in search_keywords]
[8133, 1146, 340, 861, 2951, 38015]
request_headers
[source]
request_headers
(url
)
write_db
[source]
write_db
(data
)
def get_orgs(bs):
try:
orgs = (bs
.find('dl',{'class': 'ui-ncbi-toggler-slave'})
.find_all('dd'))
return [o.get_text() for o in orgs]
except:
return 'ORGANIZATION_NA'
def get_kwords(bs):
try:
return (bs
.find('div', {'class': 'keywords'})
.find('p')
.get_text()
.split())
except:
return 'KEYWORDS_NA'
extract_page
[source]
extract_page
(url
)
extract_and_write
[source]
extract_and_write
(url
,kw
)
crawl_list
[source]
crawl_list
(page
,kw
)
crawl_pubmed
[source]
crawl_pubmed
(keywords
,start_page
=0
)
get_max_pages(search_keywords[5])
38015
keywords = search_keywords[5:]; keywords
['magnetic resonance']
# start_page = 162_594 // 20; start_page
crawl_pubmed(keywords)
Exception in thread Thread-8: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-6: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-5: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-7: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-9: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-102: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-101: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-103: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-399: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-1439: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-2149: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-2148: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-2150: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-2389: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-2554: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-4273: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-4253: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-4393: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-4392: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-4394: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-6762: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-6763: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-6747: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-6867: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-7295: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-7297: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-7293: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-7296: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-7294: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-7359: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-10701: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-11073: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-11074: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-11894: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-12651: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-13028: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-13027: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-13828: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-15151: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16103: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 11, in extract_page cit = bs.find('div', {'class': 'cit'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16118: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16122: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16126: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16130: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16136: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16132: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16154: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16160: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16153: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16165: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16171: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16178: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text' Exception in thread Thread-16175: Traceback (most recent call last): File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/Users/markyousef/anaconda3/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "<ipython-input-21-a8b7c000dc57>", line 8, in crawl extract_and_write(u, kw) File "<ipython-input-20-9e0ff25acdd7>", line 3, in extract_and_write data = extract_page(url) File "<ipython-input-19-fb2f64b408a5>", line 8, in extract_page authors = bs.find('div', {'class': 'auths'}).get_text() AttributeError: 'NoneType' object has no attribute 'get_text'
--------------------------------------------------------------------------- NoSuchElementException Traceback (most recent call last) <ipython-input-26-05b43c56e235> in <module> ----> 1 crawl_pubmed(keywords) <ipython-input-22-53aa28300743> in crawl_pubmed(keywords, start_page) 15 browser.implicitly_wait(1) 16 # Click next buttion to navigate to the next page ---> 17 browser.find_element_by_xpath('//*[@title="Next page of results"]').click() ~/anaconda3/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py in find_element_by_xpath(self, xpath) 392 element = driver.find_element_by_xpath('//div/td[1]') 393 """ --> 394 return self.find_element(by=By.XPATH, value=xpath) 395 396 def find_elements_by_xpath(self, xpath): ~/anaconda3/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py in find_element(self, by, value) 976 return self.execute(Command.FIND_ELEMENT, { 977 'using': by, --> 978 'value': value})['value'] 979 980 def find_elements(self, by=By.ID, value=None): ~/anaconda3/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py in execute(self, driver_command, params) 319 response = self.command_executor.execute(driver_command, params) 320 if response: --> 321 self.error_handler.check_response(response) 322 response['value'] = self._unwrap_value( 323 response.get('value', None)) ~/anaconda3/lib/python3.7/site-packages/selenium/webdriver/remote/errorhandler.py in check_response(self, response) 240 alert_text = value['alert'].get('text') 241 raise exception_class(message, screen, stacktrace, alert_text) --> 242 raise exception_class(message, screen, stacktrace) 243 244 def _value_or_default(self, obj, key, default): NoSuchElementException: Message: no such element: Unable to locate element: {"method":"xpath","selector":"//*[@title="Next page of results"]"} (Session info: headless chrome=80.0.3987.122)


Yea, it sounds cheesy, but if you were to have me assign a title to myself, that would be it. I am of the mind that "To live, is to learn", and I believe that there is always someway to improve yourself. I love to learn and I love to learn about everything. This blog is mostly about my adventrures in Dev BootCamp(DBC) currently and hopefully it will eventually branch out to other topics in my life.
My number one goal right now is to be a great developer and create something that will change the world. A big dream, I know, but I believe having big dreams make the journey that much greater. The time I'm having in DBC is teaching me a world of new things and this step is going to be huge in reaching my goal. Technology is such an important part of our lives and I feel like there are many unexplored ways to make it even better. I'm hoping to learn even more once I finish DBC and expand my knowledge of how technology impacts society. My dream is to make something everyone in the world will know about! I want to make something great!
I grew up in NYC as a relatively shy boy. I wasn't sure what I wanted to do when I grew up. I had family members throwing me ideas and medicine stuck out a lot for me. The feeling of being able to help people really felt like me. I started on the path to medicine and as I got older, I realized it wasn't the thing for me. I wanted to help people still, but I don't think medicine let my creative side out. I went into business for a little while to sort of test the waters, but I don't think having the dollar be the deciding factor for many of the decisions I would have to make sit well with me. I finally learned about coding and realized that "This is it", this is how I can do something creative and at the same time affect people around the world.
Hobbies, I love mine. I get very analytical with my hobbies as well, much to my friends displeasure. I love to play video games, basketball, and nowadays, code. My favorite series of video games is probably Final Fantasy and it has been with me since I was growing up. I also love to play and watch basketball. I could use some work on my jumper, I think its getting rusty. Coding has been my main thing to do since I started DBC. I enjoying working through the challenges and finding multiple ways to reach the solutions. I hope to learn more about coding in the days to come!


A grid-based design is one that works in and around the constraints of a row-and-column-based grid system to help keep your content nicely aligned. A grid is a series of intersecting horizontal and vertical lines that serve as guides to place elements in a design. To put it in simple words, grids are a system for creating order among elements in a website.
It is the only way to make websites available to all users no matter which type of device is used to view the content. Mobile browsing use is rapidly growing and could one day overtake internet browsing.
In HTML it is the tags we use to mark a document up. Creating semantic markup is nothing more complicated than understanding the language of HTML and using it to create a document that has semantic meaning.
I have learnt how important it is to code, test and refine. The most important part is to get the layout correct first before customising the website. If you are unsure of anything you can always find the answer by searching the web.


WITNESS LIST Human Services Committee February 17, 2003-2:30P Health & Human Services Commission On: Burch, Curtis (Health and Human Services Commission) Cooke, Jason (Health and Human Services Commission) Hawkins, Albert (Health and Human Services Commission) Palmer, David (Health and Human Services Commission)


OauthApplications
predicsis.jsSDK.models
| post /settings/applications | OauthApplications.create() | |
| get /settings/applications | OauthApplications.all() | |
| get /settings/applications/:token_id | OauthApplications.get() | |
| patch /settings/applications/:token_id | OauthApplications.update() | |
| delete /settings/applications/:token_id | OauthApplications.delete() | |
| Official documentation is available at: |
Output example:
{ application: { id: "540778b5353834003e050000", name: "essai", uid: "829b6d53ac27d6cf9670725eb22288dd3914d4d3a811b0d036fd5eb2bc275540", secret: "e7a9d71fbcd0e0f4f1a78b7dbbd8311d91517ca0ee1d74594db11b6a60a13732", redirect_uri: "http://truc.bidule", owner_id: "540762703263310008000000", created_at: "2014-09-03T20:23:17.025Z", updated_at: "2014-09-03T20:23:17.025Z" } }
| Object | List of all active applications { applications: [ {...}, {...}, {...} ] } |
Create a new Oauth application
| Param | Type | Details |
|---|---|---|
| name | String | Your application's name |
| redirectURI | String | The URL in your app where users will be sent after authorization |
| Object | A new and ready-to-use Oauth application { application: { id: "540778b5353834003e050000", name: "essai", uid: "829b6d53ac27d6cf9670725eb22288dd3914d4d3a811b0d0365...", secret: "e7a9d71fbcd0e0f4f1a78b7dbbd8311d91517ca0ee1d74594db...", redirect_uri: "http://truc.bidule", owner_id: "540762703263310008000000", created_at: "2014-09-03T20:23:17.025Z", updated_at: "2014-09-03T20:23:17.025Z" } } |
Revoke an application (returns a 204 No-Content)
| Object | Requested application (if exists, 404 otherwise) { application: {...} } |


All HTML headings,

through

, are available. .h1
through .h6
classes are also available, for when you want to match the font styling of a heading but still want your text to be displayed inline. Create lighter, secondary text in any heading with a generic
tag or the .small
class.
Description
This is a
-aragraph of dummy text. A style guide or style manual is a set of standards for the writing and design of documents, either for general use or for a specific publication, organization or field. The implementation of a style guide provides uniformity in style and formatting within a document and across multiple documents.
This is a shorter
-aragraph of dummy text. A set of standards for a specific organization is often known as "house style."
And one more
-aragraph of dummy text for good measure. Many publications (notably newspapers) use graphic design style guides to demonstrate the preferred layout and formatting of a published page. They often are extremely detailed in specifying, for example, which fonts and colors to use. Such guides allow a large design team to produce visually consistent work for the organization.
Make a paragraph stand out by adding .lead
.
This is a .lead
-aragraph of dummy text. Some style guides focus on graphic design, focusing on such topics as typography and white space. Web site style guides cover a publication's visual and technical aspects, along with text.
For highlighting a run of text due to its relevance in another context, use the
tag.
You may alternatively use an inline element with .mark
in place of any
.
You can use the  tag to highlight text.
For de-emphasizing inline or blocks of text, use the
tag to set text at 85% the size of the parent. (Heading elements receive their own font-size
for nested
elements.)
You may alternatively use an inline element with .small
in place of any
.
This line of text is meant to be treated as fine print.
Easily realign text to components with text alignment classes.

Left aligned text.

Center aligned text.

Right aligned text.

Justified text.

Wrap

around any HTML as the quote. For straight quotes, we recommend a

.
This is a standard
.
Add a
for identifying the source of the blockquote.
You may alternatively use
or .small
in place of
.
This is a
 with a source.
Add .blockquote-reverse
for a blockquote with right-aligned content.
You may alternatively use .pull-right
in place of .blockquote-reverse
.
This is a .blockquote-reverse with a source.
Add .list-unstyled
to remove the default list-style
and left margin on list items. This only applies to immediate children list items, meaning you will need to add the class for any nested lists as well.
Use .list-inline
to place all list items on a single line with display: inline-block;
and some light padding.
Use

,

and

to make a list of terms with their associated descriptions.
Use .dl-horizontal
to make terms and descriptions in

line up side-by-side.
Horizontal description lists will truncate terms that are too long to fit in the left column with text-overflow
. In narrower viewports, they will change to the default stacked layout.
Wrap inline snippets of code with
.
For example,

should be wrapped as inline.
Use the
to indicate input that is typically entered via keyboard.
To switch directories, type cd followed by the name of the directory.
To edit settings, press ctrl + ,
Use

for multiple lines of code. Be sure to escape any angle brackets in the code for proper rendering.

Sample text here...

Description

Sample text here...

Sample text here...

Sample text here...

Sample text here...

Sample text here...

For indicating blocks sample output from a program use the <samp>
tag.
For basic styling—light padding and only horizontal dividers—add the base class .table
to any

. It may seem super redundant, but given the widespread use of tables for other plugins like calendars and date pickers, we've opted to isolate our custom table styles.
| # | First Name | Last Name | Username |
|---|---|---|---|
| 1 | Mark | Otto | @mdo |
| 2 | Jacob | Thornton | @fat |
| 3 | Larry | the Bird |
Use .table-striped
to add zebra-striping to any table row within the

.
Striped tables are styled via the :nth-child
CSS selector, which is not available in Internet Explorer 8.
| # | First Name | Last Name | Username |
|---|---|---|---|
| 1 | Mark | Otto | @mdo |
| 2 | Jacob | Thornton | @fat |
| 3 | Larry | the Bird |
Add .table-bordered
for borders on all sides of the table and cells.
| # | First Name | Last Name | Username |
|---|---|---|---|
| 1 | Mark | Otto | @mdo |
| Mark | Otto | @TwBootstrap | |
| 2 | Jacob | Thornton | @fat |
| 3 | Larry the Bird |
Add .table-hover
to enable a hover state on table rows within a

.
| # | First Name | Last Name | Username |
|---|---|---|---|
| 1 | Mark | Otto | @mdo |
| 2 | Jacob | Thornton | @fat |
| 3 | Larry | the Bird |
Add .table-condensed
to make tables more compact by cutting cell padding in half.
| # | First Name | Last Name | Username |
|---|---|---|---|
| 1 | Mark | Otto | @mdo |
| 2 | Jacob | Thornton | @fat |
| 3 | Larry the Bird |
Use contextual classes to color table rows or individual cells.
| # | Class | Description |
|---|---|---|
| 1 | .active |
Applies the hover color to a particular row or cell |
| 2 | .success |
Indicates a successful or positive action |
| 3 | .info |
Indicates a neutral informative change or action |
| 4 | .warning |
Indicates a warning that might need attention |
| 5 | .danger |
Indicates a dangerous or potentially negative action |


{% extends "base.html" %} {% comment %} # Copyright (c) 2012 University of Oxford # # Permission is hereby granted, free of charge, to any person obtaining # a copy of this software and associated documentation files (the # "Software"), to deal in the Software without restriction, including # without limitation the rights to use, copy, modify, merge, publish, # distribute, sublicense, and/or sell copies of the Software, and to # permit persons to whom the Software is furnished to do so, subject to # the following conditions: # # The above copyright notice and this permission notice shall be # included in all copies or substantial portions of the Software. # # THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, # EXPRESS OR IMPLIED, --INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF # MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. # IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY # CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, # TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE # SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. # {% endcomment %} {% block content %}
{{ settings.SITE_NAME }} {{ settings.SITE_VERSION }} provides a platform to manage your research data that ensures your data is secure, access-controlled and back-up. {{ settings.SITE_NAME }} also enables you to create data packages for submission to a repository, providing long-term preservation, data embargoing and a Digital object identifier (DOI) for that data package.
This server hosts research data files created by {% if settings.GROUP_URL %}{{ settings.GROUP_NAME }}{% else %}{{ settings.GROUP_NAME }}{% endif %}.
{{ settings.SITE_NAME }} allows you to upload and manage your data in a number of ways.
Select they ways most appropriate for you. You may find that different methods are useful for different situations, for example you may want to set up a local file access as your main method of managing your data, but use the Web interface to browse your data remotely.


Horror as young girl knocked down in Kilwinning as town celebrates Christmas lights switch-on
Emergency services raced to the scene at Lauchlan Way following the incident.
by Colin Paterson, https://www.dailyrecord.co.uk/authors/colin-paterson/A young girl has been taken to hospital after being knocked down in Kilwinning tonight.
The town's big Christmas lights switch-on has been overshadowed following the incident on Lauchlan Way.
Police were called at approximately 6.55pm with reports of a female having been struck by a vehicle.
Paramedics raced to the scene and have taken the youngster to Kilmarnock's Crosshouse Hospital, police confirmed to Ayrshire Live.
The age of the girl and her condition are unknown at this stage and the road remains closed as officers try to establish exactly what happened.
Stagecoach West Scotland informed passengers that the closure meant their No 11 and 25A services would be diverted.


Alexey, developer of ClickHouse.
I work on data processing engine of Yandex.Metrica since 2008.
Yandex is one of the largest internet companies in Europe
operating Russia’s most popular search engine.
Yandex.Metrica (https://metrica.yandex.com/) is a service for web analytics.
Largest in Russia, second largest in the world (just after Google Analytics).
We are processing about ~25 billions of events (page views, conversions, etc) daily.
We must generate and show reports in realtime.
Big data processing is not a problem.
The challenge is how to store data in that way to allow both:
- efficient ingestion of click stream in realtime;
- efficient generation of reports;
Let review our historical solutions first...
We have had about 50 predefined report types.
We create a table for each of them.
Each table has primary key in form of:
site_id, date, key -> aggregated statistics.
The data was inserted in mini-batches of aggregated deltas,
using ON DUPLICATE KEY UPDATE.
... but this just don't work.
The main concern is data locality.
We use HDD (rotational drives).
We cannot afford petabytes of SSDs.
Each seek is ~12 ms of latency,
usually no more than 1000 random reads/second in RAID array.
Time to read data from disk array is dependent on:
- number of seeks;
- total amount of data;
Example: read 100 000 rows, randomly scattered on disk:
- at least 100 seconds in worst case.
User won't wait hundred seconds for the report.
The only way to read data from disk array in appropriate amount of time is to minimize number of seek by maintaining data locality.
Fundamental problem:
Data is inserted almost in time order:
- each second we have new portion data for this second;
- but data for different web sites are comes in random order in a stream;
Data is selected by ranges for specified web site and date period:
- in ranges of completely different order;
MyISAM stores data in MYD and MYI files.
MYD contains data almost in order of insertion.
MYI contains B-tree index that maps a key to offset in MYD file.
Insertion of data is almost fine.
But selecting of data by range of primary key was non-practical.
Nevertheless, we made it work by:
- tricky partitioning;
- organizing data in few generations with different partitioning scheme;
- moving data between tables by scheduled scripts;
- report generation becomes ugly UNION ALL queries.
As of 2011 we was storing about 580 billion rows in MyISAM tables.
We were not satisfied by performance and maintenance cost:
Example: page title report loading time, 90% quantile was more than 10 seconds.
... After all, everything was converted and deleted.
(Specialized data structure, developed specially for aggregation of data and report generation).
To maintain data locality, we need
to constantly reordering data by primary key.
We cannot maintain desired order at INSERT time, nor on SELECT time;
we must do it in background.
Obviously: we need an LSM-tree!
Metrage: Metrica + Aggregated statistics.
We have created custom data structure for that purpose.
In 2010, there was no LevelDB.
We just got some insights from article about TokuDB.
Metrage is designed for the purpose of realtime data aggregation:
- row in Metrage table is custom C++ struct with update and merge methods.
Example: a row in Metrage table could contain a HyperLogLog.
Data in Metrage is aggregated:
- on insertion, in batches;
- during background compaction;
- on the fly, during report generation.
Everything was working fine.
The problem of data locality was solved.
Reports was loading quickly.
As of 2015 we stored 3.37 trillion rows in Metrage
and used 39 * 2 servers for this.
But we have had just ~50 pre-defined reports.
No customization and drill down was possible.
The user wants to slice and dice every report by every dimension!
... and we have developed just another custom data structure.
We had quickly made a prototype of so-called "report builder".
This was 2010 year. It was just simple specialized column-oriented data structure.
It worked fine and we got understanding, what is the right direction to go.
We need good column-oriented DBMS.
This is how "traditional" row-oriented databases work:
And this is how column-oriented databases work:
Hypothesis:
If we have good enough column-oriented DBMS,
we could store all our data in non-aggregated form
(raw pageviews and sessions) and generate all the reports on the fly,
to allow infinite customization.
To check this hypothesis, we started to evaluate existing solutions.
MonetDB, InfiniDB, Infobright and so on...
No appropriate solutions were exist in 2010.
As an experimental project, we started to develop
our own column-oriented DBMS: ClickHouse.
In 2012 it was in production state.
In 2014 we re-lauched Yandex.Metrica as Metrica 2.
All data is stored in ClickHouse and in non-aggregated form
and every report is generated on the fly.
In Metrika 2 the user could create it's own report with
- custom dimensions, metrics, filters, user-centric segmentation...
- and to dig through data to the detail of individual visitors.
The main target for ClickHouse is query execution speed.
In Yandex.Metrika, users could analyze data for their web sites of any volume.
Biggest classifieds and e-commerce sites with hundreds millions PV/day are using Yandex.Metrika (e.g. ru.aliexpress.com).
In contrast to GA*, in Yandex.Metrika, you could get data reports for large web sites without sampling.
As data is processed on the fly, ClickHouse must be able to crunch all that pageviews in sub second time.
* in Google Analytics you could get reports without sampling only in "premium" version.
* If you want to try ClickHouse, one server or VM is enough.
We think ClickHouse is too good to be used solely by Yandex.
We made it open-source. License: Apache 2.0.
https://github.com/ClickHouse/ClickHouse/
More than 100 companies are already using ClickHouse.
Examples: Cloudflare, Wikimedia, Mail.ru, Kaspersky...
For well structured, clean, immutable events.
Click stream. Web analytics. Adv. networks. RTB. E-commerce.
Analytics for online games. Sensor and monitoring data. Telecom data.
OLTP
ClickHouse doesn't have UPDATE statement and full-featured transactions.
Key-Value
If you want high load of small single-row queries, please use another system.
Blob-store, document oriented
ClickHouse is intended for vast amount of fine-grained data.
Over-normalized data
Better to make up single wide fact table with pre-joined dimensions.
How do we analyze over O(100B) DNS requests daily.
"ClickHouse enables us and our customers to explore the the dataset in real time to get operational insights. Due to many of the optimizations built into ClickHouse we are able to store the data for a long time allowing us to look events is perspective and at historical trends."
"clickhouse is a columnar datastore that we are using as an aid to run complex SQL queries on the edit data "lake" that we have as a result of the edit reconstruction project. It is similar to Druid but faster for complex queries."
Throwed off InfiniDB, Cassandra and Druid
just after public release of ClickHouse.
https://www.percona.com/blog/2017/02/13/clickhouse-new-opensource-columnar-database/
Ömer Osman Koçak:
«When we evaluated ClickHouse the results were great compared to Prestodb. Even though the columnar storage optimizations for ORC and Clickhouse is quite similar, Clickhouse uses CPU and Memory resources more efficiently (Presto also uses vectorized execution but cannot take advantage of hardware level optimizations such as SIMD instruction sets because it's written in Java so that's fair) so we also wanted to add support for Clickhouse for our open-source analytics platform Rakam (https://github.com/rakam-io/rakam)»
«结论：clickhouse速度更快！»
«In conclusion, ClickHouse is faster!»
Timur Shenkao:
«ClickHouse is extremely fast at simple SELECTs without joins, much faster than Vertica».
— we just cannot make it slower.
Yandex.Metrica must work.
Algorithmic optimizations.
MergeTree, locality of data on disk
— fast range queries.
Example: uniqCombined function is a combination of three different data structures, used for different ranges of cardinalities.
Low-level optimizations.
Example: vectorized query execution.
Specialization and attention to detail.
Example: we have 17 different algorithms for GROUP BY. Best one is selected for your query.
Bioinformatics - evolutionary genetics:
https://github.com/msestak/FindOrigin
"We are exploring evolution of novel genes in genomes because if seems that genomes are far from being static as previously believed and what actually happens is that new genes are constantly being added and old genes are lost."
Search engine and analytics for Bitcoin transactions:
https://blockchair.com/
"We have quite large tables on just single server and everything works really fast &mdash with any filters and sorting everything is processed just instantly."
HTTP REST
clickhouse-client
JDBC (production), ODBC (beta)
Python, PHP, Perl, Go,
Node.js, Ruby, C++, .NET, Scala, R, Julia, Rust
Tabix (tabix.io) — specifically developed for ClickHouse.
And also:
Grafana, Redash, Apache Zeppelin,
Superset, Power BI…
Web site: https://clickhouse.com/
Google groups: https://groups.google.com/forum/#!forum/clickhouse
Maillist<EMAIL_ADDRESS>Telegram channel: https://telegram.me/clickhouse_en and https://telegram.me/clickhouse_ru (now with 714 members)
GitHub: https://github.com/ClickHouse/ClickHouse/ (now with 2478 stars)
+ meetups.
Moscow, Saint-Petersburg, Novosibirsk, Ekaterinburg, San-Francisco...
Upcoming: Minsk.


{% load i18n %}
Daisychain connects web services to make your life easier.
Daisychain is an open-source alternative for IFTTT. It is not only easy to use, but also easy to extend, easy to configure, and easy to be hosted on your own server. That way you do not have to trust some third-party closed-source service. You always own your data. You will never have to guess what is going on under the hood.
{% endblocktrans %}


{% from "projects/evaluation_section/boolean_question.html" import boolean_question with context %} {% from "projects/evaluation_section/boolean_plus_one_question.html" import boolean_plus_one_question with context %} {% macro evaluation_section(id, label, section_id, project, fa) -%} {% if project.n_answered['total'] == 0 %} {% set prct_answered = 0 %} {% set n_answered = 0 %} {% else %} {% set n_answered = project.n_answered[section_id] %} {% set prct_answered = (( project.n_answered[section_id]*100 / questions[section_id]|length)|int)/100 %} {% endif %} {% set select_idx = 1 %} {% if prct_answered < 0.5 %} {% set bar_color = 'warning' %} {% elif prct_answered < 1 %} {% set bar_color = 'info' %} {% else %} {% set bar_color = 'success' %} {% endif %}


TRIBUTE TO FELA
FELA KUTI'S JOURNEY
- Fela Aníkúlápó Kuti (born Olufela Olusegun Oludotun Ransome-Kuti; 15 October 1938 – 2 August 1997), also known as Abami Eda, was a Nigerian multi-instrumentalist, bandleader, composer, political activist, and Pan-Africanist. He is regarded as the pioneer of Afrobeat, an African music genre that combines traditional Yoruba percussion and vocal styles with American funk and jazz
- Kuti was the son of a Nigerian women's rights activist, Funmilayo Ransome-Kuti. After early experiences abroad, he and his band Africa 70 (featuring drummer Tony Allen) shot to stardom in Nigeria during the 1970s, during which he was an outspoken critic and target of Nigeria's military juntas
- In 1984, Muhammadu Buhari's government, of which Kuti was a vocal opponent, jailed him on a charge of currency smuggling. Amnesty International and others denounced the charges as politically motivated
- On 3 August 1997, Kuti's brother Olikoye Ransome-Kuti, already a prominent AIDS activist and former Minister of Health, announced Kuti's death the day before from complications related to AIDS.
- Kuti's musical style is called Afrobeat. It is a style he largely created, and is a complex fusion of jazz, funk, highlife, psychedelic rock and traditional Nigerian, African chants and rhythms. Afrobeat also borrows heavily from the native "tinker pan".
Find out more interesting facts about this great icon Fela by clicking on this Link


Information about procedures for opening a new account: To help the government fight the funding of
terrorism and money laundering activities, Federal Law requires all financial institutions to obtain, verify and
record information that identifies each person who opens an account. What this means to you: When you open an
account, we will ask your name, address, date of birth, and other information that will allow us to identify you.
Saving form
Url
For custodian accounts enter Minor in 1 and Adult in 2
Owner's Name
Owner's SSN
Owner's Date Of Birth
Owner's Physical Address
Owner's City
Owner's State
Owner's Zip
Co-Owner's Name
Co-Owner's SSN
Co-Owner's Date of Birth
Co-Owner's Physical Address
Co-Owner's City
Co-Owner's State
Co-Owner's Zip
Co-Owner's Name
Co-Owner's SSN
Co-Owner's Date of Birth
Co-Owner's Physical Address
Co-Owner's City
Co-Owner's State
Co-Owner's Zip
Co-Owner's Name
Co-Owner's SSN
Co-Owner's Date of Birth
Co-Owner's Physical Address
Co-Owner's City
Co-Owner's State
Co-Owner's Zip
ACCOUNT ACCESS SELECTIONS - BENEFICIARY INFORMATION
Beneficiaries are not allowed on Trust, Commercial or Custodian accounts. If beneficiaries were provided
earlier during the application process, they must also be included on this form.
Beneficiary's Name
Beneficiary's SSN
Beneficiary's Name
Beneficiary's SSN
Beneficiary's Name
Beneficiary's SSN
Beneficiary's Name
Beneficiary's SSN
Beneficiary's Name
Beneficiary's SSN
Beneficiary's Name
Beneficiary's SSN
ADDITIONAL INFORMATION
Taxpayer Identification Number Certification
Under penalties of perjury, I certify that: 1. The number shown on this form is my correct taxpayer
identification number (or I am waiting for a number to be issued to me), and 2. I am not subject to backup
withholding because: (a) I am exempt from backup withholding, or (b) I have not been notified by the Internal
Revenue Service (IRS) that I am subject to backup withholding as a result of a failure to report all interest or
dividends, or (c) the IRS has notified me that I am no longer subject to backup withholding, and 3. I am a
U.S.
citizen or other U.S. person (defined in the instructions). **You must cross out item 2 above if you have been
notified by the IRS that you are currently subject to backup withholding because you have failed to report all
interest and dividends on your tax return. For real estate transactions, item 2 does not apply. For mortgage
interest paid, acquisition or abandonment of secured property, cancellation of debt, contributions to an
individual retirement arrangement (IRA), and generally, payments other than interest and dividends, you are not
required to sign the certification, but you must provide your correct TIN. 4. The FATCA code(s) entered on
this
form (if any) indicating that I am exempt from FATCA reporting is correct.
Capital One reserves the right to investigate your account information which may include a review of your
credit bureau information. Should any information provided on this acceptance form prove to be false or
misleading, now or in the future, we may freeze the funds in the account pending the completion of our
investigation and may also close the account. If an account is closed, a check will be issued that includes the
funds on deposit and all interest accrued minus applicable fees and penalties, unless we have suffered a material
loss as a result of the false or misleading information, in which case you agree we may offset our loss with the
funds on deposit
Any incorrect or missing information on this signature form may cause delays in setting up this account
Information about procedures for opening a new account: To help the government fight the funding of terrorism
and money laundering activities, Federal Law requires all financial institutions to obtain, verify and record
information that identifies each person who opens an account. What this means to you: When you open an account,
we will ask your name, address, date of birth, and other information that will allow us to identify you.
Agreement to Terms
The Internal Revenue Service does not require your consent to any provisions of this document other
than the certifications required to avoid backup withholding.
I (We) agree to be bound by the Capital One Account Agreement and terms and conditions described in the account
agreement, including any and all amendments thereto. You have authorized Capital One to complete the opening of
this account upon receipt of this form.


A Platform for LGBTQ+ Teenager
We will pair you with the most suitable mentor, who will provide personalized suggestions during the program
We help you learn about the diversity in sexuality through the personal stories and experiences shared by our memtors
LGBTQ is an acronym for lesbian, gay, bisexual, transgender and queer or questioning.  According to the survey conducted by HRC Foundation and the University of Connecticut in 2018, there are more than 12,000 LGBTQ teenagers across the United States.
LGBTQ  teenager may experience high levels of anxiety at home, at school, in social circles and communities. Often, they cannot get enough help and support from people around them.
Embrace connects these teenagers to qualified mentors from our partner LGBTQ organizations. After each teenager gets paired up with a mentor, they will be able to express their feelings and get advice from someone who is experienced and empathetic.
So, if you ever need help, don't hesitate to reach out. We are here to Embrace you!


include package¶
Submodules¶
include.add module¶
-
include.add.
add
(projecthome, message)[source]¶ Add or update a blci repo
Positional Arguments:
- projecthome:
- The root directory of where the blci project is.
-
include.add.
create_base_CI_conf
(bl_conf, Git)[source]¶ Given a user defined project blci configuration file and the CI configuration file in the root of blci, create a new a config that encodes the following: - User defined tests - Triggers for code and data dependencies for any code or data change that will occur from an update action
Positional Arguments:
- bl_conf:
- A BLCI configuration
config
object - Base CI configuration file defined by blci
- A BLCI configuration
- Git:
- Git repo object from Gitpython package
-
include.add.
create_remote_repo
(bl_conf)[source]¶ Uses user-defined configuration file to create a public github repo that is initialized using configurations supplied to the BLCI configuration file.
Positional Arguments:
- bl_conf:
- A BLCI configuration
config
object with a - credentials entry that is a path for a file containing a string representing a Github OAuth2 token.
- A BLCI configuration
Returns:
A PyGithub Repository object.
-
include.add.
handle_gitignore
(projecthome, bl_conf)[source]¶ Build/update the .gitignore file and ensure that blci ignored files are not added to repo. Some files like the credentials file should never be tracked or added to the remote repo.
Positional Arguments:
- bl_conf:
- A BLCI configuration
config
object
- A BLCI configuration
- credentials_fn:
- An existing path to a file containing credentials
include.bl_exceptions module¶
include.build module¶
include.clean module¶
-
include.clean.
clean_base_ci_config
(projecthome, verbose=False)[source]¶ Delete Travis-CI configuration file
Positional Arguments:
- projecthome:
- The path to the root of the project
Optional Arguments:
- verbose:
- Print messages when actions are taken
-
include.clean.
clean_bl_config
(projecthome, verbose=False)[source]¶ Delete BLCI configuration file
Positional Arguments:
- projecthome:
- The path to the root of the project
Optional Arguments:
- verbose:
- Print messages when actions are taken
-
include.clean.
clean_dependencies
(projecthome, verbose=False)[source]¶ Delete BLCI dependency metadata file
Positional Arguments:
- projecthome:
- The path to the root of the project
include.common module¶
-
include.common.
delete
(path, verbose=False)[source]¶ Delete a file, or directory
Positional Arguments:
- path:
- The path to the file system object to be deleted
Optional Arguments:
- verbose:
- Print debug messages when actions are taken
-
include.common.
get_ext
(path)[source]¶ Given a path return the file extension.
Positional Arguments:
path: The file whose path we assess
-
include.common.
is_git_branch
(branchname, _dir='./')[source]¶ Does the the branch specified exist in the repo
Positional Arguments:
- branchname:
- The git branch you wish to evaluate existence of
Optional Arguments:
- _dir:
- The dir that is a git repo
-
include.common.
is_git_repo
(path)[source]¶ Rudimentary tests for if I have a git repo. Simply look for .git directory
Positional Arguments:
- path:
- The path that we are assessing
-
include.common.
localize
(base, path)[source]¶ Returns a localized path with respect to a base path. For instance if we have base=/home/floki/ and path=/home/floki/ragnar/foo.txt, localize will return ragnar/foo.txt
Positional Arguments:
- base:
- The base path from which we wish to localize a file path
- path:
- The path that we aim to localize
-
include.common.
ls_r
(path, fileext)[source]¶ Works like a shells ls -r syscall, but searches with a given file extensions (fileext) in mind
Positional Arguments:
- path:
- The base path from where we traverse the directory structure
- fileext:
- The file extensionS we care about when we traverse
-
include.common.
read_token
(credentials_fn)[source]¶ Read a github token from a file that has it stored as plain text
Positional Arguments:
- credentials_fn:
- An existing path to a file containing credentials
include.config module¶
-
class
include.config.
config
(fn, projecthome, on_anomaly='IGNORE', add_defaults=True)[source]¶ -
add_data_loc_path
(path)[source]¶ Add a path to the data_loc section of the blci config file.
Positional Arguments:
- path:
- The path to a data file that will be written by blci.
-
bashRE_2_pyRE
(regex)[source]¶ TODO: Very rudimentary way to change bash shell regexs to python.
Positional Arguments:
- regex:
- The bash regular expression
-
build_data_dep_stub
(overwrite=True)[source]¶ Build a stub of a config or add data dependencies to an existing config given one or more directories containing data.
Positional Arguments:
- overwrite:
- Overwrite the existing data dependency file, if it does exist.
-
get
(setting)[source]¶ Get a setting.
Positional Arguments:
- setting:
- The name of setting you seek
- Returns:
- The value of the setting.
-
has_setting
(setting)[source]¶ Does the configuration file have the setting?
Positional Arguments:
- setting:
- The name of setting you seek.
- Returns:
- A bool indicating if the setting is set or not.
-
isignored
(path)[source]¶ Determine if a provided path is meant to be ignored by blci.
Positional Arguments:
- path:
- The path or regex describing the path.
-
isvalid
()[source]¶ Is the configuration file a valid one?
Returns:
A bool for validity of the configuration file based on the on_anomaly=IGNORE argument to
__check_valid__()
-
read_config
(fn, on_anomaly='ERROR')[source]¶ Given a configuration file that is in YAML format
Positional Arguments:
- fn:
- The config filename that you are reading or intend to write
Optional Arguments:
- on_anomaly:
- Action to perform when we encounter an anomaly
-
track_datafile
(path)[source]¶ Add a path stub to the data_dep read and write sections.
Positional Arguments:
- path:
- The path to a data file that will be written by blci.
-
include.dependencies module¶
-
class
include.dependencies.
DependParser
(fileext, projecthome)[source]¶ Bases:
object
-
read
(fn)[source]¶ - Generic code reader to extract deps from a file. NOTE: The
- file extension is very important as it determines A LOT!
** Positional Arguments **
- fn:
- The filename to be read
-
include.init module¶
-
include.init.
init
(projecthome, overwrite=True)[source]¶ Initialize a blci project with the depenedency file and stubbed out blci configuration file
Positional Arguments:
- projecthome:
- The path to the root of the project
Optional Arguments:
- overwrite:
- Write over any old configuration file that may exist in projecthome.
- If False then the new configuration file will have the filename
blci_\d+.yml
.
include.settings module¶
Default file names we expect to exsit
-
include.settings.
BL_DEFAULTS
= {'ignore': ['.*', '.pyc', '.d', '.o', '.javac', '.rbin', '.mat', 'blci.yml.old'], 'code_loc': ['code'], 'version': '', 'description': 'A BrainLab Continuous Integration repo', 'credentials': '.credentials', 'data_loc': ['data'], 'path': [], 'data_dep': {'read': {}, 'write': {}}, 'nthread': 1, 'name': ''}¶ Optional arguments that can be left undefined
-
include.settings.
BL_DEFAULT_CREDS
= '.credentials'¶ These are all the settings/parameters blci supports
-
include.settings.
BL_DEFAULT_LANG_VERSION
= {'c': 'c11', 'java': 7, 'mat': 7, 'python': 2.7, 'julia': 0.4, 'r': 3, 'cpp': 'c++11'}¶ Language version defaults
-
include.settings.
BL_DEFAULT_READ
= {'c': ['.c', '.h'], 'java': ['.java'], 'mat': ['.m'], 'python': ['.py', '.pyx'], 'julia': ['.j'], 'r': ['.r'], 'cpp': ['.c', '.cpp', '.cxx', '.h', 'hpp']}¶ Configuration default values
-
include.settings.
BL_DESCRIPTION
= 'description'¶ Language version defaults
-
include.settings.
BL_REQUIRED
= set(['read', 'language'])¶ Separates Base CI (Travis) configurations from BLCI specific ones
-
include.settings.
BL_SETTINGS
= set(['code_loc', 'description', 'language', 'script', 'read', 'data_dep', 'data_loc', 'nthread', 'ignore', 'version', 'path', 'credentials', 'name'])¶ These are the default parameters blci uses
-
include.settings.
GIT_IGNORE_FN
= '.gitignore'¶ File types read by default by language


Send this approval and GPID to correct PharmaNet administrator. If this enrollee works in more than one clinic include the email addresses for all the PharmaNet administrators separated by a comma. The enrollee will also receive their GPID using the email provided in the enrolment.


This website serves as a resource for those looking to participate in the Tour de Temple 2018 activity. Theme details, safety information, preparation ideas, and much more can be found by navigating via the menu or the sections below. Take a minute to look around! If you're not sure where to go next, click the "Learn More" button below to get started.
"I promise you that if you will sincerely and persistently do the spiritual work needed to develop the crucial, spiritual skill of learning how to hear the whisperings of the Holy Ghost, you will have all the direction you will ever need in your life." - President Russell M. Nelson
Safety
Safety is of the utmost importance in all Church-sponsored activities. As such, necessary precautions must be taken to ensure the safety of all participants.
Preparation
Cycling is no easy task! Working out, practicing safe riding, eating right, and properly hydrating are but a few ways participants can prepare for the activity.
Calendar
Never miss a beat. Add these dates and events to your own personal calendar! (Additional activities and events may be added in the future, so stay tuned!)
Route Info
The journey may be long, but the path is clear! Find more information on where participants will be riding.
Volunteer
Want to lend a helping hand? Perhaps you'd prefer to ride along? There are a variety of opportunities for ward members to participate and be part of Tour de Temple 2018.
Forms
Whether you misplaced your copy or are looking for one without a grape juice stain, this is the go-to place for all required forms and documents.


Kimberly Bell Williams
Unafffiliated
hold
hold
81658
I have remained politically unbiased with no direct donations or supports to any campaigns since my employment began in 2007 due to the nature of my work in housing, wherein Elected Officials are the appointed members of the Housing Authority.
I am an appointee for my community of Eagle-Vail to the Upper Eagle Regional Water Authority board, as Secretary. I served on the EagleVail Metro District for a 2 year term since 2015. I am involved with my local church, school and housing organizations. That list includes Eagle River Presbyterian Church, Homestake Peak (dual language) School, Colorado Mountain Housing Coalition, Housing Colorado, Colorado Realtors Association, Vail Board of Realtors and The Valley Home Store.
I have worked since 2007 to advocate for local affordable deed restricted for rent and for sale housing in our municipalities, county and in partnership with state wide organizations in my professional capacity. In doing this work, I recognize a disparity in rural communities, and families of color who are at a disadvantage in affordable housing and health care. I have built coalitions of local organizations who can serve the needs of our entire community, and found that working together makes us stronger and more valuable.
I want to serve on this commission to represent the rural, Western slope, resort focused communities, who have vastly different needs that much of the state. I believe having a diverse perspective is imperative to bringing new voices to the conversation on a statewide level. The state of Colorado must consider more diversity and inclusion as we grow into our next stage of who we will be when we grow up. My experience working in housing and having my children attend a dual language learning public school has given me a new perspective on our potential. Additionally, I am skilled at critical, analytical thinking on a big picture scene. I would be thrilled to serve my state by working hard and sharing those skills.
Consensus building is a difficult task, but achieved by active listening and thoughtful consideration. The biggest challenge would be to get helpful feedback from the communities across the state. After taking these factors into consideration, impartial decisions would be achieved through slow and deliberate thinking and consideration of a multitude of perspectives. I am able to do this impartial decision making daily in my work, and with my family. Fairness is inherent in my family and working life, as we solve problems each and every day.
When I grow up, I wish to be Ruth Bader Ginsberg. Her quiet leadership and thoughtful analysis is my mantra and goal in my work and with my family. I understand the importance of active listening, before analyzing the data to seek the most logical solution, but first building consensus towards that solution with teamwork. This is no easy task, but the best working groups have these skills. I would find it imperative to work with fellow commissioners in this way.
Female


IN
- The input type for the aggregation.BUF
- The type of the intermediate value of the reduction.OUT
- The type of the final output result.public abstract class Aggregator<IN,BUF,OUT>
extends Object
implements scala.Serializable
Dataset
operations to take
all of the elements of a group and reduce them to a single value.
For example, the following aggregator extracts an int
from a specific class and adds them up:
case class Data(i: Int)
val customSummer = new Aggregator[Data, Int, Int] {
def zero: Int = 0
def reduce(b: Int, a: Data): Int = b + a.i
def merge(b1: Int, b2: Int): Int = b1 + b2
def finish(r: Int): Int = r
def bufferEncoder: Encoder[Int] = Encoders.scalaInt
def outputEncoder: Encoder[Int] = Encoders.scalaInt
}.toColumn()
val ds: Dataset[Data] = ...
val aggregated = ds.select(customSummer)
Based loosely on Aggregator from Algebird: https://github.com/twitter/algebird
| Constructor and Description |
|---|
Aggregator() |
| Modifier and Type | Method and Description |
|---|---|
abstract Encoder<BUF> |
bufferEncoder()
Specifies the
Encoder for the intermediate value type. |
abstract OUT |
finish(BUF reduction)
Transform the output of the reduction.
|
abstract BUF |
merge(BUF b1,
BUF b2)
Merge two intermediate values.
|
abstract Encoder<OUT> |
outputEncoder()
Specifies the
Encoder for the final output value type. |
abstract BUF |
reduce(BUF b,
IN a)
Combine two values to produce a new value.
|
TypedColumn<IN,OUT> |
toColumn()
Returns this
Aggregator as a TypedColumn that can be used in Dataset . |
abstract BUF |
zero()
A zero value for this aggregation.
|
public abstract Encoder<BUF> bufferEncoder()
Encoder
for the intermediate value type.public abstract OUT finish(BUF reduction)
reduction
- (undocumented)public abstract BUF merge(BUF b1, BUF b2)
b1
- (undocumented)b2
- (undocumented)public abstract Encoder<OUT> outputEncoder()
Encoder
for the final output value type.public abstract BUF reduce(BUF b, IN a)
b
and
return it instead of constructing new object for b.b
- (undocumented)a
- (undocumented)public TypedColumn<IN,OUT> toColumn()
Aggregator
as a TypedColumn
that can be used in Dataset
.
operations.public abstract BUF zero()


Former Melody Day member Chahee signs with Different Company
by beansssFormer Melody Day member Chahee has signed an exclusive contract with a new label, Different Company.
On November 8, Different Company revealed to media outlets, "We will support Chahee to our fullest ability so that she can showcase her talents as well as her unique color in a variety of fields. Please look forward to Chahee's upcoming promotions."
Meanwhile, Chahee most recently appeared as a musician on tvN's 'Studio Vibes'. She was also seen launching her very own YouTube channel afterward, and plans on greeting viewers with a new musical short-film 'Hannah' soon. Best of luck to Chahee under her new label!


{% extends "base.html" %} {% block content %}
Forgotten your password? Enter your email address below, and we'll email instructions for setting a new one.


Experienced Senior Software Engineer with hands-on experience in Investment Banking domain. Tech-Enthusiast with keen interest towards evolving web development strategies.
Full Stack Developer Angular 9.x Typescript NGRX LINQ NodeJS .NET Core REST API C# MVC AWS OCI NestJS BitBucket Git TFS
View Resume
Developed as an educational website with liberty to showcase the
wide variety of tutorials and educational content for engineering students.
Tech Stack :
Angular 9.x
NestJS
Express
MongoDB 4.2.x
Angular Material
Hosted via :
AWS
ElasticBeanStalk
S3
CloudFront
It's basically used to blog or post a review about the books. Integrated with Google's Books API.
Tech Stack :
Angular 9.x
NodeJS 12.x
Express
MongoDB 4.2.x
Angular Material
Hosted via :
Heroku
Netlify


HomeNow
Number of Bedrooms:
Any
One
Two
Three
Four
More
Number of Bathrooms:
Any
One
Two
More
Monthly Rent:
Any
<$500
$500-$650
$650-$800
$800-$1000
>$1000
Search
Developer LogIn


Margaret K Loggains
Unafffiliated
Program Coordinator, Peer Assistance Services, Inc.
BA, Psychology w/ minor in Administration of Justice. Colorado Certified Prevention Specialist. Paralegal Certificate (expired)
81503
I have not donated to any campaigns or political organizations.
Board member, Community Impact Council of Mesa County. Board member, Super Rad Art Jam. Member, Western Colorado Human Resources Association. Member, Colorado Employee Assistance Professionals Association.
In my 15 year career in nonprofit, very generally, I have been an advocate for youth from at-risk environments, at-risk and low-income seniors, and individuals with substance use disorders and addiction issues. I have also represented and organized on behalf of the nonprofit community in Colorado.
I have not been involved in anything remotely political before. Recently, I have become much more interested in political issues and would like to do something to dip my toe in the water so to speak. I also read an article in the Colorado Sun about there being a need for applicants, I'd like to help if my skill set is appropriate. I think it's importatnt.
I have served on and worked with boards in different ways throughout my nonprofit career, so I am used to working with a group to come to a consensus. I have taken trainings in facilitation, which will translate well. I have experience in leadership and have taken trainings in that area as well.
I think the work I've done that is most relevant is grant writing. To write a sucessful proposal you have to look at every funder differently, speak to their interests, match your program needs to those, use both qualitative and quantitative data to illustrate how you will be a good steward of each dollar if funded.
Female


{include:file:doc/future.md}
@!macro copy_options
@see ruby-doc.org/stdlib-2.1.1/libdoc/observer/rdoc/Observable.html Ruby Observable module @see clojuredocs.org/clojure_core/clojure.core/future Clojure's future function @see docs.oracle.com/javase/7/docs/api/java/util/concurrent/Future.html java.util.concurrent.Future
Create a new `Future` object with the given block, execute it, and return the `:pending` object.
@yield the asynchronous operation to perform
@!macro executor_and_deref_options
@option opts [object, Array] :args zero or more arguments to be passed the task
block on execution
@raise [ArgumentError] if no block is given
@return [Future] the newly created `Future` in the `:pending` state
@example
future = Concurrent::Future.execute{ sleep(1); 42 } future.state #=> :pending
# File lib/concurrent/future.rb, line 74 def self.execute(opts = {}, &block) Future.new(opts, &block).execute end
Create a new `Future` in the `:unscheduled` state.
@yield the asynchronous operation to perform
@!macro executor_and_deref_options
@option opts [object, Array] :args zero or more arguments to be passed the task
block on execution
@raise [ArgumentError] if no block is given
# File lib/concurrent/future.rb, line 30 def initialize(opts = {}, &block) raise ArgumentError.new('no block given') unless block_given? super(NULL, opts.merge(__task_from_block__: block), &nil) end
Attempt to cancel the operation if it has not already processed. The operation can only be cancelled while still `pending`. It cannot be cancelled once it has begun processing or has completed.
@return [Boolean] was the operation successfully cancelled.
# File lib/concurrent/future.rb, line 96 def cancel if compare_and_set_state(:cancelled, :pending) complete(false, nil, CancelledOperationError.new) true else false end end
Has the operation been successfully cancelled?
@return [Boolean]
# File lib/concurrent/future.rb, line 108 def cancelled? state == :cancelled end
Execute an `:unscheduled` `Future`. Immediately sets the state to `:pending` and passes the block to a new thread/thread pool for eventual execution. Does nothing if the `Future` is in any state other than `:unscheduled`.
@return [Future] a reference to `self`
@example Instance and execute in separate steps
future = Concurrent::Future.new{ sleep(1); 42 } future.state #=> :unscheduled future.execute future.state #=> :pending
@example Instance and execute in one line
future = Concurrent::Future.new{ sleep(1); 42 }.execute future.state #=> :pending
# File lib/concurrent/future.rb, line 50 def execute if compare_and_set_state(:pending, :unscheduled) @executor.post{ safe_execute(@task, @args) } self end end
@!macro ivar_set_method
# File lib/concurrent/future.rb, line 79 def set(value = NULL, &block) check_for_block_or_value!(block_given?, value) synchronize do if @state != :unscheduled raise MultipleAssignmentError else @task = block || Proc.new { value } end end execute end
Wait the given number of seconds for the operation to complete. On timeout attempt to cancel the operation.
@param [Numeric] timeout the maximum time in seconds to wait. @return [Boolean] true if the operation completed before the timeout
else false
# File lib/concurrent/future.rb, line 118 def wait_or_cancel(timeout) wait(timeout) if complete? true else cancel false end end
# File lib/concurrent/future.rb, line 130 def ns_initialize(value, opts) super @state = :unscheduled @task = opts[:__task_from_block__] @executor = Options.executor_from_options(opts) || Concurrent.global_io_executor @args = get_arguments_from(opts) end


Check out what we're up to, more events to come!
Check out what we had been up to and how we grew!
{{event.desc}}
Location: {{event.location}}
Time: {{event.time}}
Price: {{event.price}}
Want to see our {{getOther()}} events?


Topicstarter
Hi the link of the Iteminfo for HK53 changed to G53.
So there are no stats now and the links in change to another weapon are wrong.
Thanks for the great addition ^^
BrainFooLong
Administrator
Thank you.
Fixed with todays update 1.5
Greetz


Home
About Us
Events
Content
Conspiracy Theories
Current Affairs
Forum
Members
Upload a Story
Gallery
Newsletter
Newsletter
Subscribe to Newsletter


Exposure Digital's DOM and Javascript Utils
A lightweight, modern javascript utility node module.
Used for simplifying some basic functions and providing a cross browser dom manipulation API.
A lightweight, modern javascript utility node module.
Used for simplifying some basic functions and providing a cross browser dom manipulation API.


--- title: Key infrastructure map description: Key infrastructtures on the isle implemented in ArcGIS img: key_infr.jpg layout: map type: current application: ArcGISOnline base_layer: ESRI layer: ESRI Server purpose: Showcase the key infrastrutcutres on the island. --- {% include secure_warning.html %}


She excitedly moved towards it to investigate, her frustrated cursing reaching my ears as she probed it with her sharp legs and realized it wasn’t dinner.
She moved quickly and methodically around the leaf, releasing each strand that held it until it dropped to the ground, sealing up the hole like she’d done a thousand times before.
When the excitement passed she retreated back into a shadowy corner and started humming a tune that sounded familiar. I asked her, “Why do you build your web across my front stairs Spider, where there is so much wind and traffic? There are so many places out of the way that wouldn’t force you to rebuild all the time.”
 She said ”You know the answer to that better than most Strange One. Hunger brings me here. I can live with the wind as long as I live.”
I felt the weight of her silk strings, and how they shook beneath her; her tenuous patience with me, so young and full of questions. She began humming her familiar tune again.
She didn’t have much to say, but I found her song held rumblings of things to come.
Man Who Doomed
He stared out the windshield as we drove down the highway and said to me, "Do you remember when there were bugs?" "...like how your windshield used to be covered in bugs after a long drive?"
I surveyed his perfectly clear windshield, a corpse-free zone, and nodded.
We drove on for a while and he said "Too many pesticides now. No bugs, no birds."
I looked at him, thinking about birds.
A few minutes later he cut the silence again. "Do you remember how many butterflies there used to be? Big monarchs, and those little yellow ones?" He held his fingers apart an inch. "They were everywhere."
The back of his truck rattled and dark silhouettes of tall trees sailed past us and the asphalt rolled out behind us.
Pieces of memories swam in and out of my head until a distinct image bullied its way in, clear as the view out of his windshield.
I turned to him. "You never saw lightning bugs did you?"
He shook his head.
"They used to come out on summer nights when it was muggy. Their lights blink on and off real slow. It’s like magic.”
We drove on in silence, feeling the quiet ache of irrefutable loss.
She’s a Nightmare
They came in groups of three.
Nightmares always do.
Don’t ask me why, I don’t know.
There’s so much I don’t know.
What I do know is that they came to help us.
They’re here to help fight the uncontrolled fears that coalesce while we sleep,
plaguing us in our waking hours, robbing us of rest.
Nina was the youngest of the three, arguably the most wicked.
I can’t say why she chose me.
Maybe it’s because I have an uphill battle ahead of me, lifting the veil, sharing messages from voices unheard.
Maybe it’s because I was strange enough to see her as she really was.
Whatever the answer, she walked by my side for seven years, a Familiar, a friend, and a Nightmare to the end.
This is a Test
In high school I was in a play called This is A Test. It was about a boy taking a test and letting his mind get the best of him.
Over and over again, we repeated the phrase “This is a Test. A what? A Test. A what? A Test. Oh, a Test”.
By the end of the play everyone was glad to throw away their scripts and never ever revisit the one-scene comedy again. And still, so many years later I hear the phrase repeat like an alarm in my head.