title: Hierarchical Similarity Learning for Language-based Product Image Retrieval

abstract: This paper aims for the language-based product image retrieval task. The majority of previous works have made significant progress by designing network structure, similarity measurement, and loss function. However, they typically perform vision-text matching at certain granularity regardless of the intrinsic multiple granularities of images. In this paper, we focus on the cross-modal similarity measurement, and propose a novel Hierarchical Similarity Learning (HSL) network. HSL first learns multi-level representations of input data by stacked encoders, and object-granularity similarity and image-granularity similarity are computed at each level. All the similarities are combined as the final hierarchical cross-modal similarity. Experiments on a large-scale product retrieval dataset demonstrate the effectiveness of our proposed method. Code and data are available at https://github.com/liufh1/hsl.


title: NFCNN: Toward a Noise Fusion Convolutional Neural Network for Image Denoising

abstract: Deep learning based methods have achieved the state-of-the-art performance in image denoising. In this paper, a deep learning based denoising method is proposed and a module called fusion block is introduced in the convolutional neural network. For this so-called Noise Fusion Convolutional Neural Network (NFCNN), there are two branches in its multi-stage architecture. One branch aims to predict the latent clean image, while the other one predicts the residual image. A fusion block is contained between every two stages by taking the predicted clean image and the predicted residual image as a part of inputs, and it outputs a fused result to the next stage. NFCNN has an attractive texture preserving ability because of the fusion block. To train NFCNN, a stage-wise supervised training strategy is adopted to avoid the vanishing gradient and exploding gradient problems. Experimental results show that NFCNN is able to perform competitive denoising results when compared with some state-of-the-art algorithms.


title: Learning Skill Equivalencies Across Platform Taxonomies

abstract: Assessment and reporting of skills is a central feature of many digital learning platforms. With students often using multiple platforms, cross-platform assessment has emerged as a new challenge. While technologies such as Learning Tools Interoperability (LTI) have enabled communication between platforms, reconciling the different skill taxonomies they employ has not been solved at scale. In this paper, we introduce and evaluate a methodology for finding and linking equivalent skills between platforms by utilizing problem content as well as the platform's clickstream data. We propose six models to represent skills as continuous real-valued vectors and leverage machine translation to map between skill spaces. The methods are tested on three digital learning platforms: ASSISTments, Khan Academy, and Cognitive Tutor. Our results demonstrate reasonable accuracy in skill equivalency prediction from a fine-grained taxonomy to a coarse-grained one, achieving an average recall@5 of 0.8 between the three platforms. Our skill translation approach has implications for aiding in the tedious, manual process of taxonomy to taxonomy mapping work, also called crosswalks, within the tutoring as well as standardized testing worlds.


title: Characterization of high aspect ratio TiAu TES X-ray microcalorimeters array using the X-IFU Frequency Domain Multiplexing readout

abstract: We are developing X-ray microcalorimeters as a backup option for the baseline detectors in the X-IFU instrument on board the ATHENA space mission led by ESA and to be launched in the early 2030s.5$\times$5 mixed arrays with TiAu transition-edge sensor (TES), which have different high aspect ratios and thus high resistances, have been designed and fabricated to meet the energy resolution requirement of the X-IFU instrument. Such arrays can also be used to optimise the performance of the Frequency Domain Multiplexing (FDM) readout and lead to the final steps for the fabrication of a large detector array. In this work we present the experimental results from tens of the devices with an aspect ratio (length-to-width) ranging from 1-to-1 up to 6-to-1, measured in a single-pixel mode with a FDM readout system developed at SRON/VTT. We observed a nominal energy resolution of about 2.5 eV at 5.9 keV at bias frequencies ranging from 1 to 5 MHz. These detectors are proving to be the best TES microcalorimeters ever reported in Europe, being able to meet not only the requirements of the X-IFU instrument, but also those of other future challenging X-ray space missions, fundamental physics experiments, plasma characterization and material analysis.


title: UnibucKernel: Geolocating Swiss German Jodels Using Ensemble Learning

abstract: In this work, we describe our approach addressing the Social Media Variety Geolocation task featured in the 2021 VarDial Evaluation Campaign. We focus on the second subtask, which is based on a data set formed of approximately 30 thousand Swiss German Jodels. The dialect identification task is about accurately predicting the latitude and longitude of test samples. We frame the task as a double regression problem, employing an XGBoost meta-learner with the combined power of a variety of machine learning approaches to predict both latitude and longitude. The models included in our ensemble range from simple regression techniques, such as Support Vector Regression, to deep neural models, such as a hybrid neural network and a neural transformer. To minimize the prediction error, we approach the problem from a few different perspectives and consider various types of features, from low-level character n-grams to high-level BERT embeddings. The XGBoost ensemble resulted from combining the power of the aforementioned methods achieves a median distance of 23.6 km on the test data, which places us on the third place in the ranking, at a difference of 6.05 km and 2.9 km from the submissions on the first and second places, respectively.


title: Topological data analysis of C. elegans locomotion and behavior

abstract: We apply topological data analysis to the behavior of C. elegans, a widely-studied model organism in biology. In particular, we use topology to produce a quantitative summary of complex behavior which may be applied to high-throughput data. Our methods allow us to distinguish and classify videos from various environmental conditions and we analyze the trade-off between accuracy and interpretability. Furthermore, we present a novel technique for visualizing the outputs of our analysis in terms of the input. Specifically, we use representative cycles of persistent homology to produce synthetic videos of stereotypical behaviors.


title: L2E: Learning to Exploit Your Opponent

abstract: Opponent modeling is essential to exploit sub-optimal opponents in strategic interactions. Most previous works focus on building explicit models to directly predict the opponents' styles or strategies, which require a large amount of data to train the model and lack adaptability to unknown opponents. In this work, we propose a novel Learning to Exploit (L2E) framework for implicit opponent modeling. L2E acquires the ability to exploit opponents by a few interactions with different opponents during training, thus can adapt to new opponents with unknown styles during testing quickly. We propose a novel opponent strategy generation algorithm that produces effective opponents for training automatically. We evaluate L2E on two poker games and one grid soccer game, which are the commonly used benchmarks for opponent modeling. Comprehensive experimental results indicate that L2E quickly adapts to diverse styles of unknown opponents.


title: Recommending Training Set Sizes for Classification

abstract: Based on a comprehensive study of 20 established data sets, we recommend training set sizes for any classification data set. We obtain our recommendations by systematically withholding training data and developing models through five different classification methods for each resulting training set. Based on these results, we construct accuracy confidence intervals for each training set size and fit the lower bounds to inverse power low learning curves. We also estimate a sufficient training set size (STSS) for each data set based on established convergence criteria. We compare STSS to the data sets' characteristics; based on identified trends, we recommend training set sizes between 3000 and 30000 data points, according to a data set's number of classes and number of features. Because obtaining and preparing training data has non-negligible costs that are proportional to data set size, these results afford the potential opportunity for substantial savings for predictive modeling efforts.


title: Distributed control of multi-consensus

abstract: We consider the problem of steering a multi-agent system to multi-consensus, namely a regime where groups of agents agree on a given value which may be different from group to group. We first address the problem by using distributed proportional controllers that implement additional links in the network modeling the communication protocol among agents and introduce a procedure for the optimal selection of them. Both the cases of single integrators and of second-order dynamics are taken into account and the stability for the multi-consensus state is studied, ultimately providing conditions for the gain of the controllers. We then extend the approach to controllers that either add or remove links in the original structure, by preserving eventually the weak connectedness of the resulting graph.


title: Buffered Streaming Graph Partitioning

abstract: Partitioning graphs into blocks of roughly equal size is widely used when processing large graphs. Currently there is a gap in the space of available partitioning algorithms. On the one hand, there are streaming algorithms that have been adopted to partition massive graph data on small machines. In the streaming model, vertices arrive one at a time including their neighborhood and then have to be assigned directly to a block. These algorithms can partition huge graphs quickly with little memory, but they produce partitions with low solution quality. On the other hand, there are offline (shared-memory) multilevel algorithms that produce partitions with high quality but also need a machine with enough memory. We make a first step to close this gap by presenting an algorithm that computes significantly improved partitions of huge graphs using a single machine with little memory in streaming setting. First, we adopt the buffered streaming model which is a more reasonable approach in practice. In this model, a processing element can store a buffer, or batch, of nodes before making assignment decisions. When our algorithm receives a batch of nodes, we build a model graph that represents the nodes of the batch and the already present partition structure. This model enables us to apply multilevel algorithms and in turn compute much higher quality solutions of huge graphs on cheap machines than previously possible. To partition the model, we develop a multilevel algorithm that optimizes an objective function that has previously shown to be effective for the streaming setting. This also removes the dependency on the number of blocks k from the running time compared to the previous state-of-the-art. Overall, our algorithm computes, on average, 75.9% better solutions than Fennel using a very small buffer size. In addition, for large values of k our algorithm becomes faster than Fennel.


title: Convergence of stochastic gradient descent schemes for Lojasiewicz-landscapes

abstract: In this article, we consider convergence of stochastic gradient descent schemes (SGD), including momentum stochastic gradient descent (MSGD), under weak assumptions on the underlying landscape. More explicitly, we show that on the event that the SGD stays bounded we have convergence of the SGD if there is only a countable number of critical points or if the objective function satisfies Lojasiewicz-inequalities around all critical levels as all analytic functions do. In particular, we show that for neural networks with analytic activation function such as softplus, sigmoid and the hyperbolic tangent, SGD converges on the event of staying bounded, if the random variables modelling the signal and response in the training are compactly supported.


title: Enhanced Magnetic Resonance Image Synthesis with Contrast-Aware Generative Adversarial Networks

abstract: A Magnetic Resonance Imaging (MRI) exam typically consists of the acquisition of multiple MR pulse sequences, which are required for a reliable diagnosis. Each sequence can be parameterized through multiple acquisition parameters affecting MR image contrast, signal-to-noise ratio, resolution, or scan time. With the rise of generative deep learning models, approaches for the synthesis of MR images are developed to either synthesize additional MR contrasts, generate synthetic data, or augment existing data for AI training. However, current generative approaches for the synthesis of MR images are only trained on images with a specific set of acquisition parameter values, limiting the clinical value of these methods as various sets of acquisition parameter settings are used in clinical practice. Therefore, we trained a generative adversarial network (GAN) to generate synthetic MR knee images conditioned on various acquisition parameters (repetition time, echo time, image orientation). This approach enables us to synthesize MR images with adjustable image contrast. In a visual Turing test, two experts mislabeled 40.5% of real and synthetic MR images, demonstrating that the image quality of the generated synthetic and real MR images is comparable. This work can support radiologists and technologists during the parameterization of MR sequences by previewing the yielded MR contrast, can serve as a valuable tool for radiology training, and can be used for customized data generation to support AI training.


title: HyMap: eliciting hypotheses in early-stage software startups using cognitive mapping

abstract: Context: Software startups develop innovative, software-intensive products. Given the uncertainty associated with such an innovative context, experimentation is a valuable approach for these companies, especially in the early stages of the development, when implementing unnecessary features represents a higher risk for companies' survival. Nevertheless, researchers have argued that the lack of clearly defined practices led to limited adoption of experimentation. In this regard, the first step is to define the hypotheses based on which teams will create experiments. Objective: We aim to develop a systematic technique to identify hypotheses for early-stage software startups. Methods: We followed a Design Science approach consisted of three cycles in the construction phase, that involved seven startups in total, and an evaluation of the final artifact within three startups. Results: We developed the HyMap, a hypotheses elicitation technique based on cognitive mapping. It consists of a visual language to depict a cognitive map representing the founder's understanding of the product, and a process to elicit this map consisted of a series of questions the founder must answer. Our evaluation showed that the artifacts are clear, easy to use, and useful leading to hypotheses and facilitating founders to visualize their idea. Conclusion: Our study contributes to both descriptive and prescriptive bodies of knowledge. Regarding the first, it provides a better understanding of the guidance founders use to develop their startups and, for the latter, a technique to identify hypotheses in early-stage software startups.


title: ELIXIR: Learning from User Feedback on Explanations to Improve Recommender Models

abstract: System-provided explanations for recommendations are an important component towards transparent and trustworthy AI. In state-of-the-art research, this is a one-way signal, though, to improve user acceptance. In this paper, we turn the role of explanations around and investigate how they can contribute to enhancing the quality of the generated recommendations themselves. We devise a human-in-the-loop framework, called ELIXIR, where user feedback on explanations is leveraged for pairwise learning of user preferences. ELIXIR leverages feedback on pairs of recommendations and explanations to learn user-specific latent preference vectors, overcoming sparseness by label propagation with item-similarity-based neighborhoods. Our framework is instantiated using generalized graph recommendation via Random Walk with Restart. Insightful experiments with a real user study show significant improvements in movie and book recommendations over item-level feedback.


title: HSR: Hyperbolic Social Recommender

abstract: With the prevalence of online social media, users' social connections have been widely studied and utilized to enhance the performance of recommender systems. In this paper, we explore the use of hyperbolic geometry for social recommendation. We present Hyperbolic Social Recommender (HSR), a novel social recommendation framework that utilizes hyperbolic geometry to boost the performance. With the help of hyperbolic spaces, HSR can learn high-quality user and item representations for better modeling user-item interaction and user-user social relations. Via a series of extensive experiments, we show that our proposed HSR outperforms its Euclidean counterpart and state-of-the-art social recommenders in click-through rate prediction and top-K recommendation, demonstrating the effectiveness of social recommendation in the hyperbolic space.


title: A Machine Learning Approach for Early Detection of Fish Diseases by Analyzing Water Quality

abstract: Early detection of fish diseases and identifying the underlying causes are crucial for farmers to take necessary steps to mitigate the potential outbreak and thus to avert financial losses with apparent negative implications to the national economy. Typically, fish diseases are caused by viruses and bacteria; according to biochemical studies, the presence of certain bacteria and viruses may affect the level of pH, DO, BOD, COD, TSS, TDS, EC, PO43-, NO3-N, and NH3-N in water, resulting in the death of fishes. Besides, natural processes, e.g., photosynthesis, respiration, and decomposition, also contribute to the alteration of water quality that adversely affects fish health. Being motivated by the recent successes of machine learning techniques, a state-of-art machine learning algorithm has been adopted in this paper to detect and predict the degradation of water quality timely and accurately. Thus, it helps to take preemptive steps against potential fish diseases. The experimental results show high accuracy in detecting fish diseases specific to water quality based on the algorithm with real datasets.


title: Interleaving Computational and Inferential Thinking: Data Science for Undergraduates at Berkeley

abstract: The undergraduate data science curriculum at the University of California, Berkeley is anchored in five new courses that emphasize computational thinking, inferential thinking, and working on real-world problems. We believe that interleaving these elements within our core courses is essential to preparing students to engage in data-driven inquiry at the scale that contemporary scientific and industrial applications demand. This new curriculum is already reshaping the undergraduate experience at Berkeley, where these courses have become some of the most popular on campus and have led to a surging interest in a new undergraduate major and minor program in data science.


title: Risk Framework for Bitcoin Custody Operation with the Revault Protocol

abstract: Our contributions with this paper are twofold. First, we elucidate the methodological requirements for a risk framework of custodial operations and argue for the value of this type of risk model as complementary with cryptographic and blockchain security models. Second, we present a risk model in the form of a library of attack-trees for Revault -- an open-source custody protocol. The model can be used by organisations as a risk quantification framework for a thorough security analysis in their specific deployment context. Our work exemplifies an approach that can be used independent of which custody protocol is being considered, including complex protocols with multiple stakeholders and active defence infrastructure.


title: On the Convergence of Step Decay Step-Size for Stochastic Optimization

abstract: The convergence of stochastic gradient descent is highly dependent on the step-size, especially on non-convex problems such as neural network training. Step decay step-size schedules (constant and then cut) are widely used in practice because of their excellent convergence and generalization qualities, but their theoretical properties are not yet well understood. We provide the convergence results for step decay in the non-convex regime, ensuring that the gradient norm vanishes at an $\mathcal{O}(\ln T/\sqrt{T})$ rate. We also provide the convergence guarantees for general (possibly non-smooth) convex problems, ensuring an $\mathcal{O}(\ln T/\sqrt{T})$ convergence rate. Finally, in the strongly convex case, we establish an $\mathcal{O}(\ln T/T)$ rate for smooth problems, which we also prove to be tight, and an $\mathcal{O}(\ln^2 T /T)$ rate without the smoothness assumption. We illustrate the practical efficiency of the step decay step-size in several large scale deep neural network training tasks.


title: Athermal Activation in Glassy Fluid

abstract: In this article, the mechanism of the unexpected high fluidity in SiOx nanowire under modest irradiation was proposed, the high fluidity is attributed to the long lifetime of irradiation-induced holes, which arise from formation of small polarons. The holes created in irradiation could have a long lifetime, and localized in space, such missing of bonding electron could suppress the energy barrier(athermal activation effect) for a Pachner move of the network. The atomic level dynamics of the system is proposed by interaction of phonon and local configuration, the activation effect was then studied with passing rate of corresponding stochastic dynamic equation, calculation shows an exponential dependent of the time-lapse of Pachner move to lifetime of the activation, furthermore, connection between the local configuration time and viscosity of the fluid indicates a strong sensitivity of viscosity to lifetime of the athermal activation, such mechanism would give an effective interpretation to the unexpected high fluidity together with the passivation effect of the conductor on the material.


title: Robust PDF Document Conversion Using Recurrent Neural Networks

abstract: The number of published PDF documents has increased exponentially in recent decades. There is a growing need to make their rich content discoverable to information retrieval tools. In this paper, we present a novel approach to document structure recovery in PDF using recurrent neural networks to process the low-level PDF data representation directly, instead of relying on a visual re-interpretation of the rendered PDF page, as has been proposed in previous literature. We demonstrate how a sequence of PDF printing commands can be used as input into a neural network and how the network can learn to classify each printing command according to its structural function in the page. This approach has three advantages: First, it can distinguish among more fine-grained labels (typically 10-20 labels as opposed to 1-5 with visual methods), which results in a more accurate and detailed document structure resolution. Second, it can take into account the text flow across pages more naturally compared to visual methods because it can concatenate the printing commands of sequential pages. Last, our proposed method needs less memory and it is computationally less expensive than visual methods. This allows us to deploy such models in production environments at a much lower cost. Through extensive architectural search in combination with advanced feature engineering, we were able to implement a model that yields a weighted average F1 score of 97% across 17 distinct structural labels. The best model we achieved is currently served in production environments on our Corpus Conversion Service (CCS), which was presented at KDD18 (arXiv:1806.02284). This model enhances the capabilities of CCS significantly, as it eliminates the need for human annotated label ground-truth for every unseen document layout. This proved particularly useful when applied to a huge corpus of PDF articles related to COVID-19.


title: Second-order and nonuniform time-stepping schemes for time fractional evolution equations with time-space dependent coefficients

abstract: The numerical analysis of time fractional evolution equations with the second-order elliptic operator including general time-space dependent variable coefficients is challenging, especially when the classical weak initial singularities are taken into account. In this paper, we introduce a concise technique to construct efficient time-stepping schemes with variable time step sizes for two-dimensional time fractional sub-diffusion and diffusion-wave equations with general time-space dependent variable coefficients. By means of the novel technique, the nonuniform Alikhanov type schemes are constructed and analyzed for the sub-diffusion and diffusion-wave problems. For the diffusion-wave problem, our scheme is constructed by employing the recently established symmetric fractional-order reduction (SFOR) method. The unconditional stability of proposed schemes is rigorously discussed under mild assumptions on variable coefficients and, based on reasonable regularity assumptions and weak time mesh restrictions, the second-order convergence is obtained with respect to discrete $H^1$-norm. Numerical experiments are given to demonstrate the theoretical statements.


title: Meta-Transfer Learning for Low-Resource Abstractive Summarization

abstract: Neural abstractive summarization has been studied in many pieces of literature and achieves great success with the aid of large corpora. However, when encountering novel tasks, one may not always benefit from transfer learning due to the domain shifting problem, and overfitting could happen without adequate labeled examples. Furthermore, the annotations of abstractive summarization are costly, which often demand domain knowledge to ensure the ground-truth quality. Thus, there are growing appeals for Low-Resource Abstractive Summarization, which aims to leverage past experience to improve the performance with limited labeled examples of target corpus. In this paper, we propose to utilize two knowledge-rich sources to tackle this problem, which are large pre-trained models and diverse existing corpora. The former can provide the primary ability to tackle summarization tasks; the latter can help discover common syntactic or semantic information to improve the generalization ability. We conduct extensive experiments on various summarization corpora with different writing styles and forms. The results demonstrate that our approach achieves the state-of-the-art on 6 corpora in low-resource scenarios, with only 0.7% of trainable parameters compared to previous work.


title: A Reinforcement learning method for Optical Thin-Film Design

abstract: Machine learning, especially deep learning, is dramatically changing the methods associated with optical thin-film inverse design. The vast majority of this research has focused on the parameter optimization (layer thickness, and structure size) of optical thin-films. A challenging problem that arises is an automated material search. In this work, we propose a new end-to-end algorithm for optical thin-film inverse design. This method combines the ability of unsupervised learning, reinforcement learning(RL) and includes a genetic algorithm to design an optical thin-film without any human intervention. Furthermore, with several concrete examples, we have shown how one can use this technique to optimize the spectra of a multi-layer solar absorber device.


title: The Wavefunction of Continuous-Time Recurrent Neural Networks

abstract: In this paper, we explore the possibility of deriving a quantum wavefunction for continuous-time recurrent neural network (CTRNN). We did this by first starting with a two-dimensional dynamical system that describes the classical dynamics of a continuous-time recurrent neural network, and then deriving a Hamiltonian. After this, we quantized this Hamiltonian on a Hilbert space $\mathbb{H} = L^2(\mathbb{R})$ using Weyl quantization. We then solved the Schrodinger equation which gave us the wavefunction in terms of Kummer's confluent hypergeometric function corresponding to the neural network structure. Upon applying spatial boundary conditions at infinity, we were able to derive conditions/restrictions on the weights and hyperparameters of the neural network, which could potentially give insights on the the nature of finding optimal weights of said neural networks.


title: Gradeer: An Open-Source Modular Hybrid Grader

abstract: Automated assessment has been shown to greatly simplify the process of assessing students' programs. However, manual assessment still offers benefits to both students and tutors. We introduce Gradeer, a hybrid assessment tool, which allows tutors to leverage the advantages of both automated and manual assessment. The tool features a modular design, allowing new grading functionality to be added. Gradeer directly assists manual grading, by automatically loading code inspectors, running students' programs, and allowing grading to be stopped and resumed in place at a later time. We used Gradeer to assess an end of year assignment for an introductory Java programming course, and found that its hybrid approach offers several benefits.


title: Blockchain in agriculture

abstract: Blockchain is an emerging digital technology allowing ubiquitous financial transactions among distributed untrusted parties, without the need of intermediaries such as banks. This chapter examines the impact of blockchain technology in agriculture and food supply chain, presents existing ongoing projects and initiatives, and discusses overall implications, challenges and potential, with a critical view over the maturity of these projects. Our findings indicate that blockchain is a promising technology towards a transparent supply chain of food, with many ongoing initiatives in various food products and food-related issues, but many barriers and challenges still exist, which hinder its wider popularity among farmers and systems. These challenges involve technical aspects, education, policies and regulatory frameworks.


title: Joshua's Total Solar Eclipse at Gibeon

abstract: We reanalyse the solar eclipse linked to the Biblical passage about the military leader Joshua who ordered the sun to halt in the midst of the day (Joshua 10:12). Although there is agreement that the basic story is rooted in a real event, the date is subject to different opinions. We review the historical emergence of the text and confirm that the total eclipse of the sun of 30 September 1131 BCE is the most likely candidate. The Besselian Elements for this eclipse are re-computed. The error for the deceleration parameter of Earth's rotation, $\Delta T$, is improved by a factor of 2.


title: Bayesian nonparametric analysis for the detection of spikes in noisy calcium imaging data

abstract: Recent advancements in miniaturized fluorescence microscopy have made it possible to investigate neuronal responses to external stimuli in awake behaving animals through the analysis of intra-cellular calcium signals. An on-going challenge is deconvolving the temporal signals to extract the spike trains from the noisy calcium signals' time-series. In this manuscript, we propose a nested Bayesian finite mixture specification that allows the estimation of spiking activity and, simultaneously, reconstructing the distributions of the calcium transient spikes' amplitudes under different experimental conditions. The proposed model leverages two nested layers of random discrete mixture priors to borrow information between experiments and discover similarities in the distributional patterns of neuronal responses to different stimuli. Furthermore, the spikes' intensity values are also clustered within and between experimental conditions to determine the existence of common (recurring) response amplitudes. Simulation studies and the analysis of a data set from the Allen Brain Observatory show the effectiveness of the method in clustering and detecting neuronal activities.


title: Transient Performance of Tube-based Robust Economic Model Predictive Control

abstract: In this paper, we provide non-averaged and transient performance guarantees for recently developed, tube-based robust economic model predictive control (MPC) schemes. In particular, we consider both tube-based MPC schemes with and without terminal conditions. We show that the closed-loop performance obtained by applying such MPC schemes is approximately optimal when evaluated both on finite and infinite time horizons. These performance bounds are similar to those derived previously for nominal economic MPC. The theoretical results are discussed in a numerical example.


title: Finite generation for valuations computing stability thresholds and applications to K-stability

abstract: We prove that on any log Fano pair of dimension $n$ whose stability threshold is less than $\frac{n+1}{n}$, any valuation computing the stability threshold has a finitely generated associated graded ring. Together with earlier works, this implies: (a) a log Fano pair is uniformly K-stable (resp. reduced uniformly K-stable) if and only if it is K-stable (resp. K-polystable); (b) the K-moduli spaces are proper and projective; and combining with the previously known equivalence between the existence of K\"ahler-Einstein metric and reduced uniform K-stability proved by the variational approach, (c) the Yau-Tian-Donaldson conjecture holds for general (possibly singular) log Fano pairs.


title: Gradient-Tracking over Directed Graphs for solving Leaderless Multi-Cluster Games

abstract: We are concerned with finding Nash Equilibria in agent-based multi-cluster games, where agents are separated into distinct clusters. While the agents inside each cluster collaborate to achieve a common goal, the clusters are considered to be virtual players that compete against each other in a non-cooperative game with respect to a coupled cost function. In such scenarios, the inner-cluster problem and the game between the clusters need to be solved simultaneously. Therefore, the resulting inter-cluster Nash Equilibrium should also be a minimizer of the social welfare problem inside the clusters. In this work, this setup is cast as a distributed optimization problem with sparse state information. Hence, critical information, such as the agent's cost functions, remain private. We present a distributed algorithm that converges with a linear rate to the optimal solution. Furthermore, we apply our algorithm to an extended cournot game to verify our theoretical results.


title: Adaptive Rational Activations to Boost Deep Reinforcement Learning

abstract: Latest insights from biology show that intelligence not only emerges from the connections between neurons but that individual neurons shoulder more computational responsibility than previously anticipated. This perspective should be critical in the context of constantly changing distinct reinforcement learning environments, yet current approaches still primarily employ static activation functions. In this work, we motivate why rationals are suitable for adaptable activation functions and why their inclusion into neural networks is crucial. Inspired by recurrence in residual networks, we derive a condition under which rational units are closed under residual connections and formulate a naturally regularised version: the recurrent-rational. We demonstrate that equipping popular algorithms with (recurrent-)rational activations leads to consistent improvements on Atari games, especially turning simple DQN into a solid approach, competitive to DDQN and Rainbow.


title: Modulational instability and soliton generation in chiral Bose-Einstein condensates with zero-energy nonlinearity

abstract: By means of analytical and numerical methods, we address the modulational instability (MI) in chiral condensates governed by the Gross-Pitaevskiiequation including the current nonlinearity. The analysis shows that this nonlinearity partly suppresses off the MI driven by the cubic self-focusing, although the current nonlinearity is not represented in the system's energy (although it modifies the momentum), hence it may be considered as zero-energy nonlinearity. Direct simulations demonstrate generation of trains of stochastically interacting chiral solitons by MI. In the ring-shaped setup, the MI creates a single traveling solitary wave. The sign of the current nonlinearity determines the direction of propagation of the emerging solitons.


title: Adjoint Method for Macroscopic Phase-Resetting Curves of Generic Spiking Neural Networks

abstract: Brain rhythms emerge as a result of synchronization among interconnected spiking neurons. Key properties of such rhythms can be gleaned from the phase-resetting curve (PRC). Inferring the macroscopic PRC and developing a systematic phase reduction theory for emerging rhythms remains an outstanding theoretical challenge. Here we present a practical theoretical framework to compute the PRC of generic spiking networks with emergent collective oscillations. To do so, we adopt a refractory density approach where neurons are described by the time since their last action potential. In the thermodynamic limit, the network dynamics are captured by a continuity equation known as the refractory density equation. We develop an appropriate adjoint method for this equation which in turn gives a semi-analytical expression of the infinitesimal PRC. We confirm the validity of our framework for specific examples of neural networks. Our theoretical findings highlight the relationship between key biological properties at the individual neuron scale and the macroscopic oscillatory properties assessed by the PRC.


title: A Machine Learning model of the combination of normalized SD1 and SD2 indexes from 24h-Heart Rate Variability as a predictor of myocardial infarction

abstract: Aim: to evaluate the ability of the nonlinear 24-HRV as a predictor of MI using Machine Learning Methods: The sample was composed of 218 patients divided into two groups (Healthy, n=128; MI n=90). The sample dataset is part of the Telemetric and Holter Electrocardiogram Warehouse (THEW) database, from the University of Rochester Medical Center. We used the most common ML algorithms for accuracy comparison with a setting of 10-fold cross-validation (briefly, Linear Regression, Linear Discriminant Analysis, k-Nearest Neighbour, Random Forest, Supporting Vector Machine, Na\"ive Bayes, C 5.0 and Stochastic Gradient Boosting). Results: The main findings of this study show that the combination of SD1nu + SD2nu has greater predictive power for MI in comparison to other HRV indexes. Conclusion: The ML model using nonlinear HRV indexes showed to be more effective than the linear domain, evidenced through the application of ML, represented by a good precision of the Stochastic Gradient Boosting model. Keywords: heart rate variability, machine learning, nonlinear domain, cardiovascular disease


title: Counting elliptic fibrations on K3 surfaces

abstract: We solve the problem of counting jacobian elliptic fibrations on an arbitrary complex projective K3 surface up to automorphisms. We then illustrate our method with several explicit examples.


title: Copula-based Sensitivity Analysis for Multi-Treatment Causal Inference with Unobserved Confounding

abstract: Recent work has focused on the potential and pitfalls of causal identification in observational studies with multiple simultaneous treatments. Building on previous work, we show that even if the conditional distribution of unmeasured confounders given treatments were known exactly, the causal effects would not in general be identifiable, although they may be partially identified. Given these results, we propose a sensitivity analysis method for characterizing the effects of potential unmeasured confounding, tailored to the multiple treatment setting, that can be used to characterize a range of causal effects that are compatible with the observed data. Our method is based on a copula factorization of the joint distribution of outcomes, treatments, and confounders, and can be layered on top of arbitrary observed data models. We propose a practical implementation of this approach making use of the Gaussian copula, and establish conditions under which causal effects can be bounded. We also describe approaches for reasoning about effects, including calibrating sensitivity parameters, quantifying robustness of effect estimates, and selecting models that are most consistent with prior hypotheses.


title: Temporal Locality in Online Algorithms

abstract: Online algorithms make decisions based on past inputs. In general, the decision may depend on the entire history of inputs. If many computers run the same online algorithm with the same input stream but are started at different times, they do not necessarily make consistent decisions. In this work we introduce time-local online algorithms. These are online algorithms where the output at a given time only depends on $T = O(1)$ latest inputs. The use of (deterministic) time-local algorithms in a distributed setting automatically leads to globally consistent decisions. Our key observation is that time-local online algorithms (in which the output at a given time only depends on local inputs in the temporal dimension) are closely connected to local distributed graph algorithms (in which the output of a given node only depends on local inputs in the spatial dimension). This makes it possible to interpret prior work on distributed graph algorithms from the perspective of online algorithms. We describe an algorithm synthesis method that one can use to design optimal time-local online algorithms for small values of $T$. We demonstrate the power of the technique in the context of a variant of the online file migration problem, and show that e.g. for two nodes and unit migration costs there exists a $3$-competitive time-local algorithm with horizon $T=4$, while no deterministic online algorithm (in the classic sense) can do better. We also derive upper and lower bounds for a more general version of the problem; we show that there is a $6$-competitive deterministic time-local algorithm and a $2.62$-competitive randomized time-local algorithm for any migration cost $\alpha \ge 1$.


title: Synthesis, electric-field induced phase transitions and memristive properties of spontaneously ion intercalated two-dimensional MnO$_2$

abstract: Two-dimensional (2D) materials are suitable hosts for the intercalation of extrinsic guest ions such as Li+, Na+ and K+ as the interlayer coupling is weak. This allows ion intercalation engineering of 2D materials, which may be a key to advancing technological applications in energy storage, neuromorphic electronics, and bioelectronics. However, ions that are extrinsic to the host materials possess challenges in fabrication of devices as there are extra steps of ion intercalation. This results in degradation of the long-term stability of the intercalated atomically thin structures. Here, we introduce large-area single-crystal ultra-thin layered MnO$_2$ via chemical vapor deposition, spontaneously intercalated by potassium ions during the synthesis. We studied the ultra-thin 2D K-MnO$_2$ in detail and showed that charge transport in these crystals is dominated by motion of hydrated potassium ions in the interlayer space. Moreover, K-MnO$_2$ crystals exhibit reversible layered-to-spinel phase transition accompanied by an optical contrast change based on the electrical and optical modulation of the potassium and the interlayer water concentration. We used the electric field driven ionic motion in K-MnO$_2$ based devices to demonstrate the memristive properties of two terminal devices. As a possible application we showed that K-MnO$_2$ memristors display synapse-like behavior such as short and long-term potentiation and depression as well as ionic coupling effects.


title: From R\'{e}nyi Entropy Power to Information Scan of Quantum States

abstract: In the estimation theory context, we generalize the notion of Shannon's entropy power to the R\'{e}nyi-entropy setting. This not only allows to find new estimation inequalities, such as the R\'{e}nyi-entropy based De Bruijn identity, isoperimetric inequality or Stam inequality, but it also provides a convenient technical framework for the derivation of a one-parameter family of R\'{e}nyi-entropy-power-based quantum-mechanical uncertainty relations. To put more flesh on the bones, we use the R\'{e}nyi entropy power obtained to show how the information probability distribution associated with a quantum state can be reconstructed in a process that is akin to quantum-state tomography. We illustrate the inner workings of this with the so-called "cat states", which are of fundamental interest and practical use in schemes such as quantum metrology. Salient issues, including the extension of the notion of entropy power to Tsallis entropy and ensuing implications in estimation theory are also briefly discussed.


title: Coverage Probability of Distributed IRS Systems Under Spatially Correlated Channels

abstract: This paper suggests the use of multiple distributed intelligent reflecting surfaces (IRSs) towards a smarter control of the propagation environment. Notably, we also take into account the inevitable correlated Rayleigh fading in IRS-assisted systems. In particular, in a single-input and single-output (SISO) system, we consider and compare two insightful scenarios, namely, a finite number of large IRSs and a large number of finite size IRSs to show which implementation method is more advantageous. In this direction, we derive the coverage probability in closed-form for both cases contingent on statistical channel state information (CSI) by using the deterministic equivalent (DE) analysis. Next, we obtain the optimal coverage probability. Among others, numerical results reveal that the addition of more surfaces outperforms the design scheme of adding more elements per surface. Moreover, in the case of uncorrelated Rayleigh fading, statistical CSI-based IRS systems do not allow the optimization of the coverage probability.


title: Magneto-structural coupling in ilmenite-type NiTiO$_3$: a combined diffraction and dilatometry study

abstract: We report the ground state magnetic structure and in-field magnetostrictive effects of NiTiO$_3$ studied by means of zero field and in-field single-crystal neutron diffraction, magnetization, and high-resolution dilatometry experiments. Zero-field neutron diffraction on NiTiO$_3$ single crystals reveals an easy-plane antiferromagnet with a multidomain ground state. Upon application of external magnetic fields, neutron diffraction shows the evolution of domains with spins perpendicular to the applied field. The rotation of spins in the multidomain state exhibits pronounced lattice changes in the magnetostriction measurements. We see magnetization and magnetostriction measurements sale with each other in the multidomain state revealing the strong coupling of spins to the lattice.


title: Robustness of competing climatic states

abstract: The climate is a non-equilibrium system undergoing the continuous action of forcing and dissipation. Under the effect of a spatially inhomogeneous absorption of solar energy, all the climate components dynamically respond until an approximate steady state (or attractor) is reached. However, multiple steady states can co-exist for a given forcing and with the same boundary conditions. Here, we apply the Thermodynamic Diagnostic Tool (TheDiaTo) to investigate the statistical properties of five co-existing climates, ranging from a snowball to an ice-free aquaplanet, obtained in MITgcm coupled simulations. The aim is to explore the multistability of the climate model setup by highlighting differences in competing steady states and their characteristic signatures regarding the meridional transport of heat and water mass, the Lorenz energy cycle and the material entropy production. We also investigate how such attractors change when the model configuration is varied. We consider, in particular, the effect of changing the representation of the cloud albedo, and of implementing an improved closure of the energy budget. We find that, even if the dynamics remains on the same attractor, state variables are modified. The set of metrics in TheDiaTo quantifies such modifications and represents a valuable tool for model evaluation.


title: ReSonAte: A Runtime Risk Assessment Framework for Autonomous Systems

abstract: Autonomous CPSs are often required to handle uncertainties and self-manage the system operation in response to problems and increasing risk in the operating paradigm. This risk may arise due to distribution shifts, environmental context, or failure of software or hardware components. Traditional techniques for risk assessment focus on design-time techniques such as hazard analysis, risk reduction, and assurance cases among others. However, these static, design-time techniques do not consider the dynamic contexts and failures the systems face at runtime. We hypothesize that this requires a dynamic assurance approach that computes the likelihood of unsafe conditions or system failures considering the safety requirements, assumptions made at design time, past failures in a given operating context, and the likelihood of system component failures. We introduce the ReSonAte dynamic risk estimation framework for autonomous systems. ReSonAte reasons over Bow-Tie Diagrams (BTDs) which capture information about hazard propagation paths and control strategies. Our innovation is the extension of the BTD formalism with attributes for modeling the conditional relationships with the state of the system and environment. We also describe a technique for estimating these conditional relationships and equations for estimating risk based on the state of the system and environment. To help with this process, we provide a scenario modeling procedure that can use the prior distributions of the scenes and threat conditions to generate the data required for estimating the conditional relationships. To improve scalability and reduce the amount of data required, this process considers each control strategy in isolation and composes several single-variate distributions into one complete multi-variate distribution for the control strategy in question.


title: From an Interior Point to a Corner Point: Smart Crossover

abstract: Identifying optimal basic feasible solutions to linear programming problems is a critical task for mixed integer programming and other applications. The crossover method, which aims at deriving an optimal extreme point from a suboptimal solution (the output of a starting method such as interior-point methods or first-order methods), is crucial in this process. This method, compared to the starting method, frequently represents the primary computational bottleneck in practical applications. We propose approaches to overcome this bottleneck by exploiting problem characteristics and implementing customized strategies. For problems arising from network applications and exhibiting network structures, we take advantage of the graph structure of the problem and the tree structure of the optimal solutions. Based on these structures, we propose a tree-based crossover method, aiming to recovering basic solutions by identifying nearby spanning tree structures. For general linear programs, we propose recovering an optimal basic solution by identifying the optimal face and employing controlled perturbations based on the suboptimal solution provided by interior-point methods. We prove that an optimal solution for the perturbed problem is an extreme point, and its objective value is at least as good as that of the initial interior point solution. Computational experiments show significant speed-ups achieved by our methods compared to state-of-the-art commercial solvers on classical linear programming problem benchmarks, network flow problem benchmarks, and optimal transport problems.


title: AC/DC characterization of a Ti/Au TES with Au/Bi absorber for X-ray detection

abstract: Transition-edge sensors (TESs) are used as very sensitive thermometers in microcalorimeters aimed at detection of different wavelengths. In particular, for soft X-ray astrophysics, science goals require very high resolution microcalorimeters which can be achieved with TESs coupled to suitable absorbers. For many applications there is also need for a high number of pixels which typically requires multiplexing in the readout stage. Frequency Domain Multiplexing (FDM) is a common scheme and is the baseline proposed for the ATHENA mission. FDM requires biasing the TES in AC at MHz frequencies. Recently there has been reported degradation in performances under AC with respect to DC bias. In order to assess the performances of TESs to be used with FDM, it is thus of great interest to compare the performances of the same device both under AC and DC bias. This requires two different measurement setups with different processes for making the characterization. We report in this work the preliminary results of a single pixel characterization performed on a TiAu TES under AC and afterwards under DC bias in different facilities. Extraction of dynamical parameters and noise performances are compared in both cases as a first stage for further AC/DC comparison of these devices.


title: Edge partitions of the complete graph and a determinant like function

abstract: In this paper we prove the case $dim(V_3)=3$ of a conjecture about the exterior operad ${\Lambda}^{S^2}_{V_d}$. For this we introduce a collection of natural involutions on the set of homogeneous cycle-free $d$-partitions of the complete graph $K_{2d}$, and show that these involutions correspond to the relations in ${\Lambda}^{S^2}_{V_d}(2d+1)$. When $d=3$ this correspondence allows us to give an explicit description of a determinant-like map and to settle the above mentioned conjecture.


title: A pointwise differential inequality and second-order regularity for nonlinear elliptic systems

abstract: A sharp pointwise differential inequality for vectorial second-order partial differential operators, with Uhlenbeck structure, is offered. As a consequence, optimal second-order regularity properties of solutions to nonlinear elliptic systems in domains in $\mathbb{R}^n$ are derived. Both local and global estimates are established. Minimal assumptions on the boundary of the domain are required for the latter. In the special case of the $p$-Laplace system, our conclusions broaden the range of the admissible values of the exponent $p$ previously known.


title: Planets Across Space and Time (PAST). I. Characterizing the Memberships of Galactic Components and Stellar Ages: Revisiting the Kinematic Methods and Applying to Planet Host Stars

abstract: Over 4,000 exoplanets have been identified and thousands of candidates are to be confirmed. The relations between the characteristics of these planetary systems and the kinematics, Galactic components, and ages of their host stars have yet to be well explored. Aiming to addressing these questions, we conduct a research project, dubbed as PAST (Planets Across Space and Time). To do this, one of the key steps is to accurately characterize the planet host stars. In this paper, the Paper I of the PAST series, we revisit the kinematic method for classification of Galactic components and extend the applicable range of velocity ellipsoid from about 100 pc to 1, 500 pc from the sun in order to cover most known planet hosts. Furthermore, we revisit the Age-Velocity dispersion Relation (AVR), which allows us to derive kinematic age with a typical uncertainty of 10-20% for an ensemble of stars. Applying the above revised methods, we present a catalog of kinematic properties (i.e. Galactic positions, velocities, the relative membership probabilities among the thin disk, thick disk, Hercules stream, and the halo) as well as other basic stellar parameters for 2,174 host stars of 2,872 planets by combining data from Gaia, LAMOST, APOGEE, RAVE, and the NASA exoplanet archive. The revised kinematic method and AVR as well as the stellar catalog of kinematic properties and ages lay foundation for future studies on exoplanets from two dimensions of space and time in the Galactic context.


title: Two scenarios for superconductivity in CeRh$_2$As$_2$

abstract: CeRh$_2$As$_2$, a non-symmorphic heavy fermion material, was recently reported to host a remarkable phase diagram with two superconducting phases. In this material, the two inequivalent Ce sites per unit cell, related by inversion symmetry, introduce a sublattice structure corresponding to an extra internal degree of freedom. Here we propose a classification of the possible superconducting states in CeRh$_2$As$_2$ from the two Ce-sites perspective. Based on the superconducting fitness analysis and the quasiclassical Eilenberger equations, we discuss two limits: Rashba spin-orbit coupling and inter-layer hopping dominated normal state. In both limits, we are able find two scenarios that generate phase diagrams in qualitative agreement with experiments: i) intra-sublattice pairing with an even-odd transition under magnetic field, and ii) inter-sublattice pairing with an odd-odd transition under magnetic field.


title: Dynamic VNF Placement, Resource Allocation and Traffic Routing in 5G

abstract: 5G networks are going to support a variety of vertical services, with a diverse set of key performance indicators (KPIs), by using enabling technologies such as software-defined networking and network function virtualization. It is the responsibility of the network operator to efficiently allocate the available resources to the service requests in such a way to honor KPI requirements, while accounting for the limited quantity of available resources and their cost. A critical challenge is that requests may be highly varying over time, requiring a solution that accounts for their dynamic generation and termination. With this motivation, we seek to make joint decisions for request admission, resource activation, VNF placement, resource allocation, and traffic routing. We do so by considering real-world aspects such as the setup times of virtual machines, with the goal of maximizing the mobile network operator profit. To this end, first, we formulate a one-shot optimization problem which can attain the optimum solution for small size problems given the complete knowledge of arrival and departure times of requests over the entire system lifespan. We then propose an efficient and practical heuristic solution that only requires this knowledge for the next time period and works for realistically-sized scenarios. Finally, we evaluate the performance of these solutions using real-world services and large-scale network topologies. {Results demonstrate that our heuristic solution performs better than a state-of-the-art online approach and close to the optimum.


title: Deep Learning for Suicide and Depression Identification with Unsupervised Label Correction

abstract: Early detection of suicidal ideation in depressed individuals can allow for adequate medical attention and support, which in many cases is life-saving. Recent NLP research focuses on classifying, from a given piece of text, if an individual is suicidal or clinically healthy. However, there have been no major attempts to differentiate between depression and suicidal ideation, which is an important clinical challenge. Due to the scarce availability of EHR data, suicide notes, or other similar verified sources, web query data has emerged as a promising alternative. Online sources, such as Reddit, allow for anonymity that prompts honest disclosure of symptoms, making it a plausible source even in a clinical setting. However, these online datasets also result in lower performance, which can be attributed to the inherent noise in web-scraped labels, which necessitates a noise-removal process. Thus, we propose SDCNL, a suicide versus depression classification method through a deep learning approach. We utilize online content from Reddit to train our algorithm, and to verify and correct noisy labels, we propose a novel unsupervised label correction method which, unlike previous work, does not require prior noise distribution information. Our extensive experimentation with multiple deep word embedding models and classifiers display the strong performance of the method in anew, challenging classification application. We make our code and dataset available at https://github.com/ayaanzhaque/SDCNL


title: Quantum reading: the experimental set-up

abstract: The protocol of quantum reading refers to the quantum enhanced retrieval of information from an optical memory, whose generic cell stores a bit of information in two possible lossy channels. In the following we analyze the case of a particular class of optical receiver, based on photon counting measurement, since they can be particularly simple in view of real applications. We show that a quantum advantage is achievable when a transmitter based on two-mode squeezed vacuum (TMSV) states is combined with a photon counting receiver, and we experimentally confirm it. In this paper, after introducing some theoretical background, we focus on the experimental realisation, describing the data collection and the data analysis in detail.


title: AggFT: Low-Cost Fault-Tolerant Smart Meter Aggregation with Proven Termination and Privacy

abstract: Smart meter data aggregation protocols have been developed to address rising privacy threats against customers' consumption data. However, these protocols do not work satisfactorily in the presence of failures of smart meters or network communication links. In this paper, we propose a lightweight and fault-tolerant aggregation algorithm that can serve as a solid foundation for further research. We revisit an existing error-resilient privacy-preserving aggregation protocol based on masking and improve it by: (i) performing changes in the cryptographic parts that lead to a reduction of computational costs, (ii) simplifying the behaviour of the protocol in the presence of faults, and showing a proof of proper termination under a well-defined failure model, (iii) decoupling the computation part from the data flow so that the algorithm can also be used with homomorphic encryption as a basis for privacy-preservation. To best of our knowledge, this is the first algorithm that is formulated for both, masking and homomorphic encryption. (iv) Finally, we provide a formal proof of the privacy guarantee under failure. The systematic treatment with strict proofs and the established connection to graph theory may also serve as a starting point for possible generalizations and improvements with respect to increased resilience.


title: State Entropy Maximization with Random Encoders for Efficient Exploration

abstract: Recent exploration methods have proven to be a recipe for improving sample-efficiency in deep reinforcement learning (RL). However, efficient exploration in high-dimensional observation spaces still remains a challenge. This paper presents Random Encoders for Efficient Exploration (RE3), an exploration method that utilizes state entropy as an intrinsic reward. In order to estimate state entropy in environments with high-dimensional observations, we utilize a k-nearest neighbor entropy estimator in the low-dimensional representation space of a convolutional encoder. In particular, we find that the state entropy can be estimated in a stable and compute-efficient manner by utilizing a randomly initialized encoder, which is fixed throughout training. Our experiments show that RE3 significantly improves the sample-efficiency of both model-free and model-based RL methods on locomotion and navigation tasks from DeepMind Control Suite and MiniGrid benchmarks. We also show that RE3 allows learning diverse behaviors without extrinsic rewards, effectively improving sample-efficiency in downstream tasks. Source code and videos are available at https://sites.google.com/view/re3-rl.


title: Non-linearity in the system of quasiparticles of a superconducting resonator

abstract: We observed a strong non-linearity in the system of quasiparticles of a superconducting aluminum resonator, due to the Cooper-pair breaking from the absorbed readout power. We observed both negative and positive feedback effects, controlled by the detuning of the readout frequency, which are able to alter the relaxation time of quasiparticles by a factor greater than 10. We estimate that the (70+/-5) % of the total non-linearity of the device is due to quasiparticles.


title: A Stronger Impossibility for Fully Online Matching

abstract: We revisit the fully online matching model (Huang et al., J.\ ACM, 2020), an extension of the classic online matching model due to Karp, Vazirani, and Vazirani (STOC 1990), which has recently received a lot of attention (Huang et al., SODA 2019 and FOCS 2020), partly due to applications in ride-sharing platforms. It has been shown that the fully online version is harder than the classic version for which the achievable competitive ratio is at most $0.6317$, rather than precisely $1-\frac{1}{e}\approx 0.6321$. We introduce two new ideas to the construction. By optimizing the parameters of the modified construction numerically, we obtain an improved impossibility result of $0.6297$. Like the previous bound, the new bound even holds for fractional (rather than randomized) algorithms on bipartite graphs.


title: Highway Traffic Control via Smart e-Mobility -- Part II: Dutch A13 Case Study

abstract: In this paper, we study how to alleviate highway traffic congestions by encouraging plug-in electric and hybrid vehicles to stop at charging stations around peak congestion times. Specifically, we focus on a case study and simulate the adoption of a dynamic charging price depending on the traffic congestion. We use real traffic data of the A13 highway stretch between The Hague and Rotterdam, in The Netherlands, to identify the Cell Transmission Model. Then, we apply the algorithm proposed in (Part I: Theory) to different scenarios, validating the theoretical results and showing the benefits of our strategy in terms of traffic congestion alleviation. Finally, we carry out a sensitivity analysis of the proposed algorithm and discuss how to optimize its performance.


title: Mean Field Models to Regulate Carbon Emissions in Electricity Production

abstract: The most serious threat to ecosystems is the global climate change fueled by the uncontrolled increase in carbon emissions. In this project, we use mean field control and mean field game models to analyze and inform the decisions of electricity producers on how much renewable sources of production ought to be used in the presence of a carbon tax. The trade-off between higher revenues from production and the negative externality of carbon emissions is quantified for each producer who needs to balance in real time reliance on reliable but polluting (fossil fuel) thermal power stations versus investing in and depending upon clean production from uncertain wind and solar technologies. We compare the impacts of these decisions in two different scenarios: 1) the producers are competitive and hopefully reach a Nash Equilibrium; 2) they cooperate and reach a Social Optimum. We first prove that both problems have a unique solution using forward-backward systems of stochastic differential equations. We then illustrate with numerical experiments the producers' behavior in each scenario. We further introduce and analyze the impact of a regulator in control of the carbon tax policy, and we study the resulting Stackelberg equilibrium with the field of producers.


title: Security audit logging in microservice-based systems: survey of architecture patterns

abstract: Objective. Service-oriented architecture increases technical abilities for attacker to move laterally and maintain multiple pivot points inside of compromised environment. Microservice-based infrastructure brings more challenges for security architect related to internal event visibility and monitoring. Properly implemented logging and audit approach is a baseline for security operations and incident management. The aim of this study is to provide helpful resource to application and product security architects, software and operation engineers on existing architecture patterns to implement trustworthy logging and audit process in microservice-based environments. Method. In this paper, we conduct information security threats modeling and a systematic review of major electronic databases and libraries, security standards and presentations at the major security conferences as well as architecture whitepapers of industry vendors with relevant products. Results and practical relevance. In this work based on research papers and major security conferences presentations analysis, we identified industry best practices in logging audit patterns and its applicability depending on environment characteristic. We provided threat modeling for typical architecture pattern of logging system and identified 8 information security threats. We provided security threat mitigation and as a result of 11 high-level security requirements for audit logging system were identified. High-level security requirements can be used by application security architect in order to secure their products.


title: Interleaving classical and reversible

abstract: Given a simple recursive function, we show how to extract two interacting processes from it. The two processes can be described by means of iterative programs, one of which is intrinsically reversible, in a language that, up to minor details, belongs to the core of widely used imperative programming languages. We implement the two processes as interleaving synchronous JAVA threads whose interaction is equivalent to the recursive function they are extracted from.


title: hesim: Health Economic Simulation Modeling and Decision Analysis

abstract: Health economic models simulate the costs and effects of health technologies for use in health technology assessment (HTA) to inform efficient use of scarce resources. Models have historically been developed using spreadsheet software (e.g., Microsoft Excel) and while use of R is growing, general purpose modeling software is still limited. hesim is an R package that helps fill this gap by facilitating parameterization, simulation, and analysis of economic models in an integrated manner. Supported model types include cohort discrete time state transition models (cDTSTMs), individual continuous time state transition models (iCTSTMs), and partitioned survival models (PSMs), encompassing Markov (time-homogeneous and time-inhomogeneous) and semi-Markov processes. A modular design based on R6 and S3 classes allows users to combine separate submodels for disease progression, costs, and utility in a flexible way. Probabilistic sensitivity analysis (PSA) is used to propagate uncertainty in model parameters to model outputs. Simulation code is written in C++ so complex simulations such as those combining PSA and individual simulation can be run much more quickly than previously possible. Decision analysis within a cost-effectiveness framework is performed using simulated costs and quality-adjusted life years (QALYs) from a PSA.


title: Invariant Center Power and Elliptic Loci of Poncelet Triangles

abstract: We study center power with respect to circles derived from Poncelet 3-periodics (triangles) in a generic pair of ellipses as well as loci of their triangle centers. We show that (i) for any concentric pair, the power of the center with respect to either circumcircle or Euler's circle is invariant, and (ii) if a triangle center of a 3-periodic in a generic nested pair is a fixed affine combination of barycenter and circumcenter, its locus over the family is an ellipse.


title: Probing black hole microstructure with the kinetic turnover of phase transition

abstract: By treating black hole as the macroscopic stable state on the free energy landscape, we propose that the stochastic dynamics of the black hole phase transition can be effectively described by the Langevin equation or equivalently by the Fokker-Planck equation in phase space. We demonstrate the turnover of the kinetics for the charged anti-de Sitter black hole phase transition, which shows that the mean first passage time is linear with the friction in the high damping regime and inversely proportional to the friction in the low damping regime. The fluctuations in the kinetics are shown to be large/small in the high/low damping regime and the switching behavior from the small fluctuations to the large fluctuations takes place at the kinetic turnover point. Because the friction is a reflection of the microscopic degrees of freedom acting on the order parameter of the black hole, the turnover and the corresponding fluctuations of the phase transition kinetics can be used to probe the black hole microstructure.


title: Jeans modeling of axisymmetric galaxies with multiple stellar populations

abstract: We present the theoretical framework to efficiently solve the Jeans equations for multi-component axisymmetric stellar systems, focusing on the scaling of all quantities entering them. The models may include an arbitrary number of stellar distributions, a dark matter halo, and a central supermassive black hole; each stellar distribution is implicitly described by a two- or three-integral distribution function, and the stellar components can have different structural (density profile, flattening, mass, scale-length), dynamical (rotation, velocity dispersion anisotropy), and population (age, metallicity, initial mass function, mass-to-light ratio) properties. In order to determine the ordered rotational velocity and the azimuthal velocity dispersion fields of each component, we introduce a decomposition that can be used when the commonly adopted Satoh decomposition cannot be applied. The scheme developed is particularly suitable for a numerical implementation; we describe its realisation within our code JASMINE2, optimised to maximally exploit the scalings allowed by the Poisson and the Jeans equations, also in the post-processing procedures. As applications, we illustrate the building of three multi-component galaxy models with two distinct stellar populations, a central black hole, and a dark matter halo; we also study the solution of the Jeans equations for an exponential thick disc, and for its multi-component representation as the superposition of three Miyamoto-Nagai discs. A useful general formula for the numerical evaluation of the gravitational potential of factorised thick discs is finally given.


title: A super-Earth on a close-in orbit around the M1V star GJ 740. A HADES and CARMENES collaboration

abstract: M-dwarfs have proven to be ideal targets for planetary radial velocity (RV) searches due to their higher planet-star mass contrast. The HADES and CARMENES programs aim to carry out extensive searches of exoplanetary systems around this type of stars in the northern hemisphere, allowing us to address statistically the properties of the planets orbiting these objects. In this work, we perform a spectroscopic and photometric study of one of the program stars (GJ 740), which exhibits a short-period RV signal compatible with a planetary companion. We carried out a spectroscopic analysis based on 129 HARPS-N spectra taken over a time-span of 6 yr combined with 57 HARPS spectra taken over 4 yr, as well as 32 CARMENES spectra taken during more than 1 yr, resulting in a dataset with a time coverage of 10 yr. We also relied on 459 measurements from the public ASAS survey with a time-coverage of 8 yr along with 5 yr of photometric magnitudes from the EXORAP project taken in the $V$, $B$, $R$, and $I$ filters to carry out a photometric study. Both analyses were made using Markov Chain Monte Carlo (MCMC) simulations and Gaussian Process regression to model the activity of the star. We present the discovery of a short-period super-Earth with an orbital period of 2.37756$^{+0.00013}_{-0.00011}$ d and a minimum mass of 2.96$^{+0.50}_{-0.48}$ M$_{\oplus}$. We offer an update to the previously reported characterization of the magnetic cycle and rotation period of the star, obtaining values of $P_{\rm rot}$=35.563$\pm$0.071 d and $P_{\rm cycle}$=2800$\pm$150 d. Furthermore, the RV time-series exhibits a possibly periodic long-term signal which might be related to a Saturn-mass planet of $\sim$ 100 M$_{\oplus}$.


title: Stable Elements and Property (S)

abstract: We study the relation (and differences) between stability and Property (S) in the simple and stably finite framework. This leads us to characterize stable elements in terms of its support, and study these concepts from different sides : hereditary subalgebras, projections in the multiplier algebra and order properties in the Cuntz semigroup. We use these approaches to show both that cancellation at infinity on the Cuntz semigroup just holds when its Cuntz equivalence is given by isomorphism at the level of Hilbert right-modules, and that different notions as Regularity, $\omega$-comparison, Corona Factorization Property, property R, etc.. are equivalent under mild assumptions.


title: Engineering the optical vacuum: Arbitrary magnitude, sign, and order of dispersion in free space using space-time wave packets

abstract: Spatial structuring of an optical pulse can lead in some cases upon free propagation to changes in its temporal profile. For example, introducing conventional angular dispersion into the field results in the pulse encountering group-velocity dispersion in free space. However, only limited control is accessible via this strategy. Here we show that precise and versatile control can be exercised in free space over the dispersion profile of so-called `space-time' wave packets: a class of pulsed beams undergirded by non-differentiable angular dispersion. This abstract mathematical feature allows us to tune the magnitude and sign of the different dispersion orders without introducing losses, thereby realizing arbitrary dispersion profiles, and achieving dispersion values unattainable in optical materials away from resonance. Unlike optical materials and photonic structures in which the values of the different dispersion orders are not independent of each other, these orders are addressable separately using our strategy. These results demonstrate the versatility of space-time wave packets as a platform for structured light and point towards their utility in nonlinear and quantum optics.


title: Testing Robustness of Camera Fingerprint (PRNU) Detectors

abstract: In the field of forensic imaging, it is important to be able to extract a 'camera fingerprint' from one or a small set of images known to have been taken by the same camera. Ideally, that fingerprint would be used to identify an individual source camera. Camera fingerprint is based on certain kind of random noise present in all image sensors that is due to manufacturing imperfections and thus unique and impossible to avoid. PRNU (Photo-Response Non-Uniformity) has become the most widely used method for SCI (Source Camera Identification). In this paper, we design a set of 'attacks' to a PRNU based SCI system and we measure the success of each method. We understand an attack method as any processing that alters minimally image quality and that is designed to fool PRNU detectors (or, generalizing, any camera fingerprint detector). The PRNU based SCI system was taken from an outstanding reference that is publicly available.


title: Conditions in the WR 140 wind-collision region revealed by the 1.083-micron He I line profile

abstract: We present spectroscopy of the P~Cygni profile of the 1.083-micron He I line in the WC7 + O5 colliding-wind binary (CWB) WR 140 (HD 193793), observed in 2008, before its periastron passage in 2009, and in 2016-17, spanning the subsequent periastron passage. Both absorption and emission components showed strong variations. The variation of the absorption component as the O5 star was occulted by the wind-collision region (WCR) sets a tight constraint on its geometry. While the sightline to the O5 star traversed the WCR, the strength and breadth of the absorption component varied significantly on time-scales of days. An emission sub-peak was observed on all our profiles. The variation of its radial velocity with orbital phase was shown to be consistent with formation in the WCR as it swung round the stars in their orbit. Modelling the profile gave a measure of the extent of the sub-peak forming region. In the phase range 0.93-0.99, the flux in the sub-peak increased steadily, approximately inversely proportionally to the stellar separation, indicating that the shocked gas in the WCR where the line was formed was adiabatic. After periastron, the sub-peak flux was anomalously strong and varied rapidly, suggesting formation in clumps down-stream in the WCR. For most of the time, its flux exceeded the 2-10-keV X-ray emission, showing it to be a significant coolant of the shocked wind.


title: Experimental Designs for Accelerated Degradation Tests Based on Linear Mixed Effects Models

abstract: Accelerated degradation tests are used to provide accurate estimation of lifetime properties of highly reliable products within a relatively short testing time. There data from particular tests at high levels of stress (e.\,g.\ temperature, voltage, or vibration) are extrapolated, through a physically meaningful model, to obtain estimates of lifetime quantiles under normal use conditions. In this work, we consider repeated measures accelerated degradation tests with multiple stress variables, where the degradation paths are assumed to follow a linear mixed effects model which is quite common in settings when repeated measures are made. We derive optimal experimental designs for minimizing the asymptotic variance for estimating the median failure time under normal use conditions when the time points for measurements are either fixed in advance or are also to be optimized.


title: 101 Trojans: a tale of period bimodality, binaries, and extremely slow rotators from K2 photometry

abstract: Various properties of Jovian trojan asteroids such as composition, rotation periods, and photometric amplitudes, or the rate of binarity in the population can provide information and constraints on the evolution of the group and of the Solar System itself. Here we present new photometric properties of 45 Jovian trojans from the K2 mission of the Kepler space telescope, and present phase-folded light curves for 44 targets, including (11351) Leucus, one of the targets of the Lucy mission. We extend our sample to 101 asteroids with previous K2 Trojan measurements, then compare their combined amplitude- and frequency distributions to other ground-based and space data. We show that there is a dichotomy in the periods of Trojans with a separation at $\sim 100$ hr. We find that 25% of the sample are slow rotators (P$\geq$30 hr), which excess can be attributed to binary objects. We also show that 32 systems can be classified as potential detached binary systems. Finally, we calculate density and rotation constraints for the asteroids. Both the spin barrier and fits to strengthless ellipsoid models indicate low densities and thus compositions similar to cometary and TNO populations throughout the sample. This supports the scenario of outer Solar System origin for Jovian trojans.


title: A Generative Approach to Joint Modeling of Quantitative and Qualitative Responses

abstract: In many scientific areas, data with quantitative and qualitative (QQ) responses are commonly encountered with a large number of predictors. By exploring the association between QQ responses, existing approaches often consider a joint model of QQ responses given the predictor variables. However, the dependency among predictive variables also provides useful information for modeling QQ responses. In this work, we propose a generative approach to model the joint distribution of the QQ responses and predictors. The proposed generative model provides efficient parameter estimation under a penalized likelihood framework. It achieves accurate classification for qualitative response and accurate prediction for quantitative response with efficient computation. Because of the generative approach framework, the asymptotic optimality of classification and prediction of the proposed method can be established under some regularity conditions. The performance of the proposed method is examined through simulations and real case studies in material science and genetics.


title: Quantum field-theoretic machine learning

abstract: We derive machine learning algorithms from discretized Euclidean field theories, making inference and learning possible within dynamics described by quantum field theory. Specifically, we demonstrate that the $\phi^{4}$ scalar field theory satisfies the Hammersley-Clifford theorem, therefore recasting it as a machine learning algorithm within the mathematically rigorous framework of Markov random fields. We illustrate the concepts by minimizing an asymmetric distance between the probability distribution of the $\phi^{4}$ theory and that of target distributions, by quantifying the overlap of statistical ensembles between probability distributions and through reweighting to complex-valued actions with longer-range interactions. Neural network architectures are additionally derived from the $\phi^{4}$ theory which can be viewed as generalizations of conventional neural networks and applications are presented. We conclude by discussing how the proposal opens up a new research avenue, that of developing a mathematical and computational framework of machine learning within quantum field theory.

categories: hep-lat cond-mat.dis-nn cond-mat.stat-mech cs.LG hep-th


title: Ideal pairing of the Stokes and anti-Stokes photons in the Raman process

abstract: A quantum model of the Raman process with the independent Stokes and anti-Stokes nonlinear interactions is developed to study nonclassical correlations between the photons in the Stokes and anti-Stokes fields. The role of the laser pump amplitude, the ratio of the Stokes and anti-Stokes coupling constants and the population and losses of the vibrational mode in forming the correlations is elucidated. The $ g^{(2)} $ intensity cross-correlation function, noise-reduction-factor, two-mode principal squeezing variance, logarithmic negativity, non-classicality depth, steering parameter and the Bell parameter are analyzed side-by-side to shed light to the correlations between the Stokes and anti-Stokes fields. Conditions for having the Stokes and anti-Stokes fields composed of only photon pairs, similarly as it occurs in twin beams in parametric down-conversion, are revealed. They allow for nonzero mean thermal phonon numbers.


title: Diagonal equations with restricted solution sets

abstract: Let $\mathbb{F}_q$ be a finite field with $q=p^n$ elements. In this paper, we study the number of solutions of equations of the form $a_1 x_1^{d_1}+\dots+a_s x_s^{d_s}=b$ with $x_i\in\mathbb{F}_{p^{t_i}}$, where $b\in\mathbb{F}_q$ and $t_i|n$ for all $i=1,\dots,s$. In our main results, we employ results on quadratic forms to give an explicit formula for the number of solutions of diagonal equations with restricted solution sets satisfying certain natural restrictions on the exponents. As a consequence, we present conditions for the existence of solutions. We also discuss further questions concerning equations with restricted solution sets and present some open problems.


title: Replicator equations induced by microscopic processes in nonoverlapping population playing bimatrix games

abstract: This paper is concerned with exploring the microscopic basis for the discrete versions of the standard replicator equation and the adjusted replicator equation. To this end, we introduce frequency-dependent selection -- as a result of competition fashioned by game-theoretic consideration -- into the Wright--Fisher process, a stochastic birth-death process. The process is further considered to be active in a generation-wise nonoverlapping finite population where individuals play a two-strategy bimatrix population game. Subsequently, connections among the corresponding master equation, the Fokker--Planck equation, and the Langevin equation are exploited to arrive at the deterministic discrete replicator maps in the limit of infinite population size.


title: Towards augmented reality for corporate training

abstract: Corporate training relates to employees acquiring essential skills to operate equipment or effectively performing required tasks both competently and safely. Unlike formal education, training can be incorporated into the task workflow and performed during working hours. Increasingly, organizations adopt different technologies to develop both individual skills and improve their organization. Studies indicate that Augmented Reality (AR) is quickly becoming an effective technology for training programs. This systematic literature review (SLR) aims to screen works published on AR for corporate training. We describe AR training applications, discuss current challenges, literature gaps, opportunities, and tendencies of corporate AR solutions. We structured a protocol to define keywords, the semantics of research, and databases used as sources of this SLR. From a primary analysis, we considered 1952 articles in the review for qualitative synthesis. We selected 60 among the selected articles for this study. The survey shows a large number of 41.7% of applications focused on automotive and medical training. Additionally, 20% of selected publications use a camera-display with a tablet device, while 40% refer to head-mounted-displays, and many surveyed approaches (45%) adopt marker-based tracking. Results indicate that publications on AR for corporate training increased significantly in recent years. AR has been used in many areas, exhibiting high quality and provides viable approaches to On-The-Job training. Finally, we discuss future research issues related to increasing relevance regarding AR for corporate training.


title: Localisation in quasiperiodic chains: a theory based on convergence of local propagators

abstract: Quasiperiodic systems serve as fertile ground for studying localisation, due to their propensity already in one dimension to exhibit rich phase diagrams with mobility edges. The deterministic and strongly-correlated nature of the quasiperiodic potential nevertheless offers challenges distinct from disordered systems. Motivated by this, we present a theory of localisation in quasiperiodic chains with nearest-neighbour hoppings, based on the convergence of local propagators; exploiting the fact that the imaginary part of the associated self-energy acts as a probabilistic order parameter for localisation transitions and, importantly, admits a continued-fraction representation. Analysing the convergence of these continued fractions, localisation or its absence can be determined, yielding in turn the critical points and mobility edges. Interestingly, we find anomalous scalings of the order parameter with system size at the critical points, consistent with the fractal character of critical eigenstates. Self-consistent theories at high orders are also considered, shown to be conceptually connected to the theory based on continued fractions, and found in practice to converge to the same result. Results are exemplified by analysing the theory for three quasiperiodic models covering a range of behaviour.

categories: cond-mat.dis-nn cond-mat.quant-gas cond-mat.stat-mech quant-ph


title: To Improve Cyber Resilience, Measure It

abstract: We are not very good at measuring -- rigorously and quantitatively -- the cyber security of systems. Our ability to measure cyber resilience is even worse. And without measuring cyber resilience, we can neither improve it nor trust its efficacy. It is difficult to know if we are improving or degrading cyber resilience when we add another control, or a mix of controls, to harden the system. The only way to know is to specifically measure cyber resilience with and without a particular set of controls. What needs to be measured are temporal patterns of recovery and adaptation, and not time-independent failure probabilities. In this paper, we offer a set of criteria that would ensure decision-maker confidence in the reliability of the methodology used in obtaining a meaningful measurement.


title: Inflation, phase transitions and the cosmological constant

abstract: Cosmological phase transitions are thought to have taken place at the early Universe imprinting their properties on the observable Universe. There is strong evidence that, through the dynamics of a scalar field that lead a second order phase transition, inflation shaped the Universe accounting for the most conspicuous features of the observed Universe. It is argued that inflation has also striking implications for the vacuum energy. Considerations for subsequent second order phase transitions are also discussed.


title: K-stability and Fujita approximation

abstract: We derive a formula for non-Archimedean Monge-Amp\`{e}re measures of big models. As applications, we derive a positive intersection formula for non-Archimedean Mabuchi functional, and further reduce the uniform Yau-Tian-Donaldson conjecture for polarized manifolds to a conjecture about the existence of approximate Zariski decompositions that satisfy some asymptotic vanishing condition.


title: DPNCT: A Differential Private Noise Cancellation Scheme for Load Monitoring and Billing for Smart Meters

abstract: Highly accurate profiles of consumers daily energy usage are reported to power grid via smart meters which enables smart grid to effectively regulate power demand and supply. However, consumers energy consumption pattern can reveal personal and sensitive information regarding their lifestyle. Therefore, to ensure users privacy, differentially distributed noise is added to the original data. This technique comes with a trade off between privacy of the consumer versus utility of the data in terms of providing services like billing, Demand Response schemes, and Load Monitoring. In this paper, we propose a technique - Differential Privacy with Noise Cancellation Technique (DPNCT) - to maximize utility in aggregated load monitoring and fair billing while preserving users privacy by using noise cancellation mechanism on differentially private data. We introduce noise to the sensitive data stream before it leaves smart meters in order to guarantee privacy at individual level. Further, we evaluate the effects of different periodic noise cancelling schemes on privacy and utility i.e., billing and load monitoring. Our proposed scheme outperforms the existing scheme in terms of preserving the privacy while accurately calculating the bill.


title: Tilted Cone and Cylinder, Cone and Tilted Sphere

abstract: In this note, we will consider two classical volume problems related to elliptic integrals. The first problem has a neat formula by means of elliptic integrals. We remade it with details. In the second problem, we found a messy formula. On the other hand, it seems to be useful to find a good approximation for the volume.


title: TCN: Table Convolutional Network for Web Table Interpretation

abstract: Information extraction from semi-structured webpages provides valuable long-tailed facts for augmenting knowledge graph. Relational Web tables are a critical component containing additional entities and attributes of rich and diverse knowledge. However, extracting knowledge from relational tables is challenging because of sparse contextual information. Existing work linearize table cells and heavily rely on modifying deep language models such as BERT which only captures related cells information in the same table. In this work, we propose a novel relational table representation learning approach considering both the intra- and inter-table contextual information. On one hand, the proposed Table Convolutional Network model employs the attention mechanism to adaptively focus on the most informative intra-table cells of the same row or column; and, on the other hand, it aggregates inter-table contextual information from various types of implicit connections between cells across different tables. Specifically, we propose three novel aggregation modules for (i) cells of the same value, (ii) cells of the same schema position, and (iii) cells linked to the same page topic. We further devise a supervised multi-task training objective for jointly predicting column type and pairwise column relation, as well as a table cell recovery objective for pre-training. Experiments on real Web table datasets demonstrate our method can outperform competitive baselines by +4.8% of F1 for column type prediction and by +4.1% of F1 for pairwise column relation prediction.