title: Neural Input Search for Large Scale Recommendation Models

abstract: Recommendation problems with large numbers of discrete items, such as products, webpages, or videos, are ubiquitous in the technology industry. Deep neural networks are being increasingly used for these recommendation problems. These models use embeddings to represent discrete items as continuous vectors, and the vocabulary sizes and embedding dimensions, although heavily influence the model's accuracy, are often manually selected in a heuristical manner. We present Neural Input Search (NIS), a technique for learning the optimal vocabulary sizes and embedding dimensions for categorical features. The goal is to maximize prediction accuracy subject to a constraint on the total memory used by all embeddings. Moreover, we argue that the traditional Single-size Embedding (SE), which uses the same embedding dimension for all values of a feature, suffers from inefficient usage of model capacity and training data. We propose a novel type of embedding, namely Multi-size Embedding (ME), which allows the embedding dimension to vary for different values of the feature. During training we use reinforcement learning to find the optimal vocabulary size for each feature and embedding dimension for each value of the feature. In experiments on two common types of large scale recommendation problems, i.e. retrieval and ranking problems, NIS automatically found better vocabulary and embedding sizes that result in $6.8\%$ and $1.8\%$ relative improvements on Recall@1 and ROC-AUC over manually optimized ones.


title: The stochastic multi-gradient algorithm for multi-objective optimization and its application to supervised machine learning

abstract: Optimization of conflicting functions is of paramount importance in decision making, and real world applications frequently involve data that is uncertain or unknown, resulting in multi-objective optimization (MOO) problems of stochastic type. We study the stochastic multi-gradient (SMG) method, seen as an extension of the classical stochastic gradient method for single-objective optimization. At each iteration of the SMG method, a stochastic multi-gradient direction is calculated by solving a quadratic subproblem, and it is shown that this direction is biased even when all individual gradient estimators are unbiased. We establish rates to compute a point in the Pareto front, of order similar to what is known for stochastic gradient in both convex and strongly convex cases. The analysis handles the bias in the multi-gradient and the unknown a priori weights of the limiting Pareto point. The SMG method is framed into a Pareto-front type algorithm for the computation of the entire Pareto front. The Pareto-front SMG algorithm is capable of robustly determining Pareto fronts for a number of synthetic test problems. One can apply it to any stochastic MOO problem arising from supervised machine learning, and we report results for logistic binary classification where multiple objectives correspond to distinct-sources data groups.


title: CMB-S4 Science Case, Reference Design, and Project Plan

abstract: We present the science case, reference design, and project plan for the Stage-4 ground-based cosmic microwave background experiment CMB-S4.


title: Ultrareliable and Low-Latency Communication Techniques for Tactile Internet Services

abstract: This paper presents novel ultrareliable and low-latency communication (URLLC) techniques for URLLC services, such as Tactile Internet services. Among typical use-cases of URLLC services are tele-operation, immersive virtual reality, cooperative automated driving, and so on. In such URLLC services, new kinds of traffic such as haptic information including kinesthetic information and tactile information need to be delivered in addition to high-quality video and audio traffic in traditional multimedia services. Further, such a variety of traffic has various characteristics in terms of packet sizes and data rates with a variety of requirements of latency and reliability. Furthermore, some traffic may occur in a sporadic manner but require reliable delivery of packets of medium to large sizes within a low latency, which is not supported by current state-of-the-art wireless communication systems and is very challenging for future wireless communication systems. Thus, to meet such a variety of tight traffic requirements in a wireless communication system, novel technologies from the physical layer to the network layer need to be devised. In this paper, some novel physical layer technologies such as waveform multiplexing, multiple access scheme, channel code design, synchronization, and full-duplex transmission for spectrally-efficient URLLC are introduced. In addition, a novel performance evaluation approach, which combines a ray-tracing tool and system-level simulation, is suggested for evaluating the performance of the proposed schemes. Simulation results show the feasibility of the proposed schemes providing realistic URLLC services in realistic geographical environments, which encourages further efforts to substantiate the proposed work.


title: Hyperon production in $\Lambda_c^+\to K^-p\pi^+$ and $\Lambda_c^+\to K^0_Sp\pi^0 $

abstract: We investigate $S=-1$ hyperon production from the $\Lambda_c^+\to K^-p\pi^+$ and $\Lambda_c^+\to K^0_Sp\pi^0$ decays within the effective Lagrangian approach. We consider the $\Sigma/\Lambda$ ground states, $\Lambda(1520)$, $\Lambda(1670)(J^p=1/2^-)$, $\Lambda(1890)(J^p=3/2^+)$; $\Lambda/\Sigma$-pole contributions from the combined resonances between 1800 MeV and 2100 MeV; and $N/\Delta$-pole and $K^\ast$-pole contributions, which include the proton, $\Delta(1232)$, and $K(892)$. We calculate the Dalitz plot density $(d^2\Gamma/dM_{K^-p}dM_{K^-\pi^+}$) for the $\Lambda_c^+\to K^-p\pi^+$ decay. The calculated result is in good agreement with experimental data from the Belle Collaboration. Using the parameters from the fit, we present the Dalitz plot density for the $\Lambda_c^+\to K^0_Sp\pi^0$ decay. In our calculation, a sharp peak-like structure near 1665 MeV is predicted in the $\Lambda_c^+\to K^-p\pi^+$ decay because of the interference effects between the $\Lambda(1670)$ resonance and $\eta$-$\Lambda$ loop channels. We also demonstrate that we can access direct information regarding the weak couplings of $\Lambda(1670)$ and $\Sigma(1670)$ from the $\Lambda_c^+\to K^0_Sp\pi^0$ decay. Finally, a possible interpretation for the 1665 MeV structure beyond our prediction is briefly discussed.


title: A New Benchmark and Approach for Fine-grained Cross-media Retrieval

abstract: Cross-media retrieval is to return the results of various media types corresponding to the query of any media type. Existing researches generally focus on coarse-grained cross-media retrieval. When users submit an image of "Slaty-backed Gull" as a query, coarse-grained cross-media retrieval treats it as "Bird", so that users can only get the results of "Bird", which may include other bird species with similar appearance (image and video), descriptions (text) or sounds (audio), such as "Herring Gull". Such coarse-grained cross-media retrieval is not consistent with human lifestyle, where we generally have the fine-grained requirement of returning the exactly relevant results of "Slaty-backed Gull" instead of "Herring Gull". However, few researches focus on fine-grained cross-media retrieval, which is a highly challenging and practical task. Therefore, in this paper, we first construct a new benchmark for fine-grained cross-media retrieval, which consists of 200 fine-grained subcategories of the "Bird", and contains 4 media types, including image, text, video and audio. To the best of our knowledge, it is the first benchmark with 4 media types for fine-grained cross-media retrieval. Then, we propose a uniform deep model, namely FGCrossNet, which simultaneously learns 4 types of media without discriminative treatments. We jointly consider three constraints for better common representation learning: classification constraint ensures the learning of discriminative features, center constraint ensures the compactness characteristic of the features of the same subcategory, and ranking constraint ensures the sparsity characteristic of the features of different subcategories. Extensive experiments verify the usefulness of the new benchmark and the effectiveness of our FGCrossNet. They will be made available at https://github.com/PKU-ICST-MIPL/FGCrossNet_ACMMM2019.


title: Epsilon Theorems in Intermediate Logics

abstract: Any intermediate propositional logic (i.e., a logic including intuitionistic logic and contained in classical logic) can be extended to a calculus with epsilon- and tau-operators and critical formulas. For classical logic, this results in Hilbert's $\varepsilon$-calculus. The first and second $\varepsilon$-theorems for classical logic establish conservativity of the $\varepsilon$-calculus over its classical base logic. It is well known that the second $\varepsilon$-theorem fails for the intuitionistic $\varepsilon$-calculus, as prenexation is impossible. The paper investigates the effect of adding critical $\varepsilon$- and $\tau$-formulas and using the translation of quantifiers into $\varepsilon$- and $\tau$-terms to intermediate logics. It is shown that conservativity over the propositional base logic also holds for such intermediate $\varepsilon\tau$-calculi. The "extended" first $\varepsilon$-theorem holds if the base logic is finite-valued G\"odel-Dummett logic, fails otherwise, but holds for certain provable formulas in infinite-valued G\"odel logic. The second $\varepsilon$-theorem also holds for finite-valued first-order G\"odel logics. The methods used to prove the extended first $\varepsilon$-theorem for infinite-valued G\"odel logic suggest applications to theories of arithmetic.


title: User Detection Performance Analysis for Grant-Free Uplink Transmission in Large-Scale Antenna Systems

abstract: In this paper, user detection performance of a grant-free uplink transmission in a large scale antenna system is analyzed, in which a general grant-free multiple access is considered as the system model and Zadoff-Chu sequence is used for the uplink pilot. The false alarm probabilities of various user detection schemes under the target detection probabilities are evaluated.


title: Magnetostatic Analogy of the Zero Energy State of Jackiw-Rebbi

abstract: We prepared a similarity between the Poisson equation in non-homogeneous magnetic material media and Dirac's one-dimensional equation for the zero-energy state, which establishes a connections with the Jackiw-Rebbi model in one dimension for this same state.


title: Noncommutative Schur-type products and their Schoenberg theorem

abstract: Schoenberg showed that a function $f:(-1,1)\rightarrow \mathbb{R}$ such that $C=[c_{ij}]_{i,j}$ positive semi-definite implies that $f(C)=[f(c_{ij})]_{i,j}$ is also positive semi-definite must be analytic and have Taylor series coefficients nonnegative at the origin. The Schoenberg theorem is essentially a theorem about the functional calculus arising from the Schur product, the entrywise product of matrices. Two important properties of the Schur product are that the product of two rank one matrices is rank one, and the product of two positive semi-definite matrices is positive semi-definite. We classify all products which satisfy these two properties and show that these generalized Schur products satisfy a Schoenberg type theorem.


title: Tails of Lipschitz Triangular Flows

abstract: We investigate the ability of popular flow based methods to capture tail-properties of a target density by studying the increasing triangular maps used in these flow methods acting on a tractable source density. We show that the density quantile functions of the source and target density provide a precise characterization of the slope of transformation required to capture tails in a target density. We further show that any Lipschitz-continuous transport map acting on a source density will result in a density with similar tail properties as the source, highlighting the trade-off between a complex source density and a sufficiently expressive transformation to capture desirable properties of a target density. Subsequently, we illustrate that flow models like Real-NVP, MAF, and Glow as implemented originally lack the ability to capture a distribution with non-Gaussian tails. We circumvent this problem by proposing tail-adaptive flows consisting of a source distribution that can be learned simultaneously with the triangular map to capture tail-properties of a target density. We perform several synthetic and real-world experiments to compliment our theoretical findings.


title: Evolutionary Multi-Objective Optimization Driven by Generative Adversarial Networks

abstract: Recently, more and more works have proposed to drive evolutionary algorithms using machine learning models.Usually, the performance of such model based evolutionary algorithms is highly dependent on the training qualities of the adopted models.Since it usually requires a certain amount of data (i.e. the candidate solutions generated by the algorithms) for model training, the performance deteriorates rapidly with the increase of the problem scales, due to the curse of dimensionality.To address this issue, we propose a multi-objective evolutionary algorithm driven by the generative adversarial networks (GANs).At each generation of the proposed algorithm, the parent solutions are first classified into \emph{real} and \emph{fake} samples to train the GANs; then the offspring solutions are sampled by the trained GANs.Thanks to the powerful generative ability of the GANs, our proposed algorithm is capable of generating promising offspring solutions in high-dimensional decision space with limited training data.The proposed algorithm is tested on 10 benchmark problems with up to 200 decision variables.Experimental results on these test problems demonstrate the effectiveness of the proposed algorithm.


title: Copula Representations and Error Surface Projections for the Exclusive Or Problem

abstract: The exclusive or (xor) function is one of the simplest examples that illustrate why nonlinear feedforward networks are superior to linear regression for machine learning applications. We review the xor representation and approximation problems and discuss their solutions in terms of probabilistic logic and associative copula functions. After briefly reviewing the specification of feedforward networks, we compare the dynamics of learned error surfaces with different activation functions such as RELU and tanh through a set of colorful three-dimensional charts. The copula representations extend xor from Boolean to real values, thereby providing a convenient way to demonstrate the concept of cross-validation on in-sample and out-sample data sets. Our approach is pedagogical and is meant to be a machine learning prolegomenon.


title: Co-training for Policy Learning

abstract: We study the problem of learning sequential decision-making policies in settings with multiple state-action representations. Such settings naturally arise in many domains, such as planning (e.g., multiple integer programming formulations) and various combinatorial optimization problems (e.g., those with both integer programming and graph-based formulations). Inspired by the classical co-training framework for classification, we study the problem of co-training for policy learning. We present sufficient conditions under which learning from two views can improve upon learning from a single view alone. Motivated by these theoretical insights, we present a meta-algorithm for co-training for sequential decision making. Our framework is compatible with both reinforcement learning and imitation learning. We validate the effectiveness of our approach across a wide range of tasks, including discrete/continuous control and combinatorial optimization.


title: Assortment planning for two-sided sequential matching markets

abstract: Two-sided matching platforms provide users with menus of match recommendations. To maximize the number of realized matches between the two sides (referred here as customers and suppliers), the platform must balance the inherent tension between recommending customers more potential suppliers to match with and avoiding potential collisions. We introduce a stylized model to study the above trade-off. The platform offers each customer a menu of suppliers, and customers choose, simultaneously and independently, either a supplier from their menu or to remain unmatched. Suppliers then see the set of customers that have selected them, and choose to either match with one of these customers or to remain unmatched. A match occurs if a customer and a supplier choose each other (in sequence). Agents' choices are probabilistic, and proportional to public scores of agents in their menu and a score that is associated with remaining unmatched. The platform's problem is to construct menus for costumers to maximize the number of matches. This problem is shown to be strongly NP-hard via a reduction from 3-partition. We provide an efficient algorithm that achieves a constant-factor approximation to the expected number of matches.


title: Critical behaviour of an effective relativistic mean field model in the presence of magnetic background and boundaries

abstract: In the present work we investigate the combined influence of magnetic background and boundaries on the thermodynamic properties of effective relativistic mean field models, like the so-called Walecka model. This is done by making use of generalized zeta-function approach and mean-field approximation at effective chemical equilibrium, focusing on the dependence with the size of compactified spatial dimension, the temperature and the magnetic field strength. The findings suggest a rich phase structure in the parameter space. The maintenance of long-range correlations is strongly affected under the change of these parameters, with the symmetric phase being favoured due to both inverse magnetic catalysis effect and the reduction of size of compactified dimension.


title: A Short Virtual Reality Mindfulness Meditation Training For Regaining Sustained Attention

abstract: The ability to focus one's attention underlies success in many everyday tasks, but voluntary attention cannot be sustained for a long period of time. Several studies indicate that attention training using computer-based exercises can lead to improved attention in children and adults. a major goal of recent research is to create a short (10 minutes) and effective VR Mindfulness meditation particularly designed for regaining or improving sustained attention. In this study, we have created a custom virtually relaxing environment including an archery game with multiple targets. In the experiment, the attention span of 12 adults are tested before and after the virtual reality session by a non-action video game ([19]) score and Muse headband EEG-signals. After the 10-minute virtual reality session participants' game scores increased (according to game experience): for the beginner by 275%, for intermediate by 107%, and for an expert by 17%. For Muse headband data, calm points increased by 250% irrespective of the participants gaming experiences. After the experiment, all participants reported feeling recharged to continue their daily activities.


title: Decaying turbulence and magnetic fields in galaxy clusters

abstract: We explore the decay of turbulence and magnetic fields generated by fluctuation dynamo action in the context of galaxy clusters where such a decaying phase can occur in the aftermath of a major merger event. Using idealized numerical simulations that start from a kinetically dominated regime we focus on the decay of the steady state rms velocity and the magnetic field for a wide range of conditions that include varying the compressibility of the flow, the forcing wave number, and the magnetic Prandtl number. Irrespective of the compressibility of the flow, both the rms velocity and the rms magnetic field decay as a power-law in time. In the subsonic case we find that the exponent of the power-law is consistent with the $-3/5$ scaling reported in previous studies. However, in the transonic regime both the rms velocity and the magnetic field initially undergo rapid decay with an $\approx t^{-1.1}$ scaling with time. This is followed by a phase of slow decay where the decay of the rms velocity exhibits an $\approx -3/5$ scaling in time, while the rms magnetic field scales as $\approx -5/7$. Furthermore, analysis of the Faraday rotation measure reveals that the Faraday RM decays also decays as a power law in time $\approx t^{-5/7}$; steeper than the $\sim t^{-2/5}$ scaling obtained in previous simulations of magnetic field decay in subsonic turbulence. Apart from galaxy clusters, our work can have potential implications in the study of magnetic fields in elliptical galaxies.


title: Deep Lagrangian Networks for end-to-end learning of energy-based control for under-actuated systems

abstract: Applying Deep Learning to control has a lot of potential for enabling the intelligent design of robot control laws. Unfortunately common deep learning approaches to control, such as deep reinforcement learning, require an unrealistic amount of interaction with the real system, do not yield any performance guarantees, and do not make good use of extensive insights from model-based control. In particular, common black-box approaches -- that abandon all insight from control -- are not suitable for complex robot systems. We propose a deep control approach as a bridge between the solid theoretical foundations of energy-based control and the flexibility of deep learning. To accomplish this goal, we extend Deep Lagrangian Networks (DeLaN) to not only adhere to Lagrangian Mechanics but also ensure conservation of energy and passivity of the learned representation. This novel extension is embedded within generic model-based control laws to enable energy control of under-actuated systems. The resulting DeLaN for energy control (DeLaN 4EC) is the first model learning approach using generic function approximation that is capable of learning energy control. DeLaN 4EC exhibits excellent real-time control on the physical Furuta Pendulum and learns to swing-up the pendulum while the control law using system identification does not.


title: Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learning

abstract: Deep learning has achieved astonishing results on many tasks with large amounts of data and generalization within the proximity of training data. For many important real-world applications, these requirements are unfeasible and additional prior knowledge on the task domain is required to overcome the resulting problems. In particular, learning physics models for model-based control requires robust extrapolation from fewer samples - often collected online in real-time - and model errors may lead to drastic damages of the system. Directly incorporating physical insight has enabled us to obtain a novel deep model learning approach that extrapolates well while requiring fewer samples. As a first example, we propose Deep Lagrangian Networks (DeLaN) as a deep network structure upon which Lagrangian Mechanics have been imposed. DeLaN can learn the equations of motion of a mechanical system (i.e., system dynamics) with a deep network efficiently while ensuring physical plausibility. The resulting DeLaN network performs very well at robot tracking control. The proposed method did not only outperform previous model learning approaches at learning speed but exhibits substantially improved and more robust extrapolation to novel trajectories and learns online in real-time


title: SDSS-IV MaNGA: Spatial Evolution of Star Formation Triggered by Galaxy Interactions

abstract: Galaxy interaction is considered a key driver of galaxy evolution and star formation (SF) history. In this paper, we present an empirical picture of the radial extent of interaction-triggered SF along the merger sequence. The samples under study are drawn from the integral field spectroscopy (IFS) survey SDSS-IV MaNGA, including 205 star-forming galaxies in pairs/mergers and ~1350 control galaxies. For each galaxy in pairs, the merger stage is identified according to its morphological signatures: incoming phase, at first pericenter passage, at apocenter, in merging phase, and in final coalescence. The effect of interactions is quantified by the global and spatially resolved SF rate relative to the SF rate of a control sample selected for each individual galaxy ($\Delta$logSFR and $\Delta$logsSFR(r), respectively). Analysis of the radial $\Delta$logsSFR(r) distributions shows that galaxy interactions have no significant impact on the $\Delta$logsSFR(r) during the incoming phase. Right after the first pericenter passage, the radial $\Delta$logsSFR(r) profile decreases steeply from enhanced to suppressed activity for increasing galactocentric radius. Later on, SF is enhanced on a broad spatial scale out to the maximum radius we explore (~6.7 kpc) and the enhancement is in general centrally peaked. The extended SF enhancement is also observed for systems at their apocenters and in the coalescence phase, suggesting that interaction-triggered SF is not restricted to the central region of a galaxy. Further explorations of a wide range in parameter space of merger configurations (e.g., mass ratio) are required to constrain the whole picture of interaction-triggered SF.


title: Exploiting user-frequency information for mining regionalisms from Social Media texts

abstract: The task of detecting regionalisms (expressions or words used in certain regions) has traditionally relied on the use of questionnaires and surveys, and has also heavily depended on the expertise and intuition of the surveyor. The irruption of Social Media and its microblogging services has produced an unprecedented wealth of content, mainly informal text generated by users, opening new opportunities for linguists to extend their studies of language variation. Previous work on automatic detection of regionalisms depended mostly on word frequencies. In this work, we present a novel metric based on Information Theory that incorporates user frequency. We tested this metric on a corpus of Argentinian Spanish tweets in two ways: via manual annotation of the relevance of the retrieved terms, and also as a feature selection method for geolocation of users. In either case, our metric outperformed other techniques based solely in word frequency, suggesting that measuring the amount of users that produce a word is informative. This tool has helped lexicographers discover several unregistered words of Argentinian Spanish, as well as different meanings assigned to registered words.


title: Exploring Topological Superconductivity in Topological Materials

abstract: The exploration of topological superconductivity and Majorana zero modes has become a rapidly developing field. Many types of proposals to realize topological superconductors have been presented, and significant advances have been recently made. In this review, we conduct a survey on the experimental progress in possible topological superconductors and induced superconductivity in topological insulators or semimetals as well as artificial structures. The approaches to inducing superconductivity in topological materials mainly include high pressure application, the hard-tip point contact method, chemical doping or intercalation, the use of artificial topological superconductors, and electric field gating. The evidence supporting topological superconductivity and signatures of Majorana zero modes are also discussed and summarized.


title: Controlling Power and Virtual Inertia from Storage for Frequency Response

abstract: Nowadays, power imbalance happens more frequently due to the more integration of renewable energy sources. Energy storage is a kind of devices that can charge energy at one time and discharge energy at another time. This function makes that storage is widely envolved into promoting power balance of power system. Besides this function, storage can also emulate virtual inertia to respond to frequency deviations in the system. This work provides a generalized optimization framework to analyze how to control power and virtual inertia from storage to participate in frequency response when a large disturbance happens. Centralized and distributed model predictive control is employed here, and case study verifies the effectiveness of our optimization framework.


title: Direct detection of the cosmic expansion: the redshift drift and the flux drift

abstract: The redshift drift, the change of cosmological redshift with time, is a direct consequence of the expansion of the Universe. Thus the measurement of the cosmological redshift drift will offer a direct test of our models of cosmology. The magnitude of the effect is very small, i.e. the spectral shift is of order of $10^{-10} - 10^{-9}$ over the period of a decade, but the next generation facilities such as ELT and SKA will be able to directly detect the expansion of our Universe by the year 2040. In this paper we focus on detectebility of this effect, including strategies of overcoming the kinematic contamination of the cosmological signal. We also show that the redshift drift directly impacts the change of flux. Thus apart from the redshift drift, measurements of the flux drift will provide an additional tool of detecting the expansion of the universe, including its acceleration. We discuss the strategies of detecting the flux drift and show that by including the flux drift signal to the redshift drift signal we boost the chances of a direct detection of the expansion of the Universe. We show that if only the stability of flux is at the level of $\Delta F/F \sim 10^{-6}$ then the SKA1-mid Array should be able to detect these effects, before the ETL and the full SKA. Thus, by including the flux drift into the SKA1-mid Array's analysis pipeline, we could be able to provide by mid-2030s a direct evidence of the expansion of the universe including its accelerating phase.


title: Dopant Solubility, and Charge Compensation in La-doped SrSnO3 Films

abstract: We investigate lanthanum (La) as an n-type dopant in the strain-stabilized tetragonal phase of SrSnO3 grown on GdScO3 (110) using a radical-based hybrid molecular beam epitaxy approach. Fully coherent, epitaxial films with atomically smooth film surface were obtained irrespective of doping density. By combining secondary ion mass spectroscopy and Hall measurements, we demonstrate that each La atom contributes to one electron to the film confirming it occupies Sr-site in SrSnO3 and that it is completely activated. Carrier density exceeding 1 x 10^20 cm-3 was achieved in LSSO films, which is in excellent agreement with the dopant-solubility limit predicted by the density functional theory calculations. A record-high room-temperature mobility of 70 cm2V-1s-1 at 1 x 10^20 cm-3 was obtained in 12 nm La-doped SrSnO3 film making this the thinnest perovskite oxide semiconductor with a reasonably high electron mobility at room temperature. We discuss the structure-dopant-transport property relationships providing essential knowledge for the design of electronic devices using these materials.


title: 2-Designs and Redundant Syndrome Extraction for Quantum Error Correction

abstract: Imperfect measurement can degrade a quantum error correction scheme. A solution that restores fault tolerance is to add redundancy to the process of syndrome extraction. In this work, we show how to optimize this process for an arbitrary ratio of data qubit error probability to measurement error probability. The key is to design the measurements so that syndromes that correspond to different errors are separated by the maximum distance in the signal space, in close analogy to classical error correction codes. We find that the mathematical theory of 2-designs, appropriately modified, is the right tool for this. Analytical and simulation results for the bit-flip code, the 5-qubit code, and the Steane code are presented. The results show that design-based redundancy protocols show improvement in both cost and performance relative to conventional fault-tolerant error-correction schemes in situations, quite important in practice, where measure errors are common. In the near term, the construction of a fault-tolerant logical qubit with a small number of noisy physical qubits will benefit from targeted redundancy in syndrome extraction.


title: Speed Scaling with Tandem Servers

abstract: Speed scaling for a tandem server setting is considered, where there is a series of servers, and each job has to be processed by each of the servers in sequence. Servers have a variable speed, their power consumption being a convex increasing function of the speed. We consider the worst case setting as well as the stochastic setting. In the worst case setting, the jobs are assumed to be of unit size with arbitrary (possibly adversarially determined) arrival instants. For this problem, we devise an online speed scaling algorithm that is constant competitive with respect to the optimal offline algorithm that has non-causal information. The proposed algorithm, at all times, uses the same speed on all active servers, such that the total power consumption equals the number of outstanding jobs. In the stochastic setting, we consider a more general tandem network, with a parallel bank of servers at each stage. In this setting, we show that random routing with a simple gated static speed selection is constant competitive. In both cases, the competitive ratio depends only on the power functions, and is independent of the workload and the number of servers.


title: Determination of the damping co-efficient of electrons in optically transparent glasses at the true resonance frequency in the ultraviolet from an analysis of the Lorentz-Maxwell model of dispersion

abstract: The Lorentz-Maxwell model of dispersion of light has been analyzed in this paper to determine the true resonance frequency in the ultraviolet for the electrons in optically transparent glasses and the damping coefficient at this frequency. For this we needed the refractive indices of glass in the optical frequency range. We argue that the true resonance condition in the absorption region prevails when the frequency at which the absorption coefficient is maximum is the same as the frequency at which the average energy per cycle of the electrons is also a maximum. We have simultaneously solved the two equations obtained from the two maxima conditions numerically to arrive at a unique solution for the true resonance frequency and the damping coefficient at this frequency. Assuming the damping coefficient to be constant over a small frequency range in the absorption region, we have determined the frequencies at which the extinction coefficient and the reflectance are maxima. These frequencies match very well with the published data for silica glasses available from the literature.


title: Fetal Pose Estimation in Volumetric MRI using a 3D Convolution Neural Network

abstract: The performance and diagnostic utility of magnetic resonance imaging (MRI) in pregnancy is fundamentally constrained by fetal motion. Motion of the fetus, which is unpredictable and rapid on the scale of conventional imaging times, limits the set of viable acquisition techniques to single-shot imaging with severe compromises in signal-to-noise ratio and diagnostic contrast, and frequently results in unacceptable image quality. Surprisingly little is known about the characteristics of fetal motion during MRI and here we propose and demonstrate methods that exploit a growing repository of MRI observations of the gravid abdomen that are acquired at low spatial resolution but relatively high temporal resolution and over long durations (10-30 minutes). We estimate fetal pose per frame in MRI volumes of the pregnant abdomen via deep learning algorithms that detect key fetal landmarks. Evaluation of the proposed method shows that our framework achieves quantitatively an average error of 4.47 mm and 96.4\% accuracy (with error less than 10 mm). Fetal pose estimation in MRI time series yields novel means of quantifying fetal movements in health and disease, and enables the learning of kinematic models that may enhance prospective mitigation of fetal motion artifacts during MRI acquisition.


title: Halo Acceleration Relation

abstract: Recently, from the new Spitzer Photometry and Accurate Rotation Curves (SPARC) data, McGaugh et al. (2016) reported a tight Radial Acceleration Relation (RAR) between the observed total acceleration and the acceleration produced by baryons in spiral galaxies. The relation can be fitted by different functions. However, these functions can be discerned if we express the data in the form of halo acceleration relation (HAR). The data reveals a maximum in the halo acceleration. We examined NFW (cusp) and Burkert (core) profiles in the context of dark matter and different parameter families of the interpolating function in the framework of Modified Newtonian Dynamics (MOND).


title: DeepXDE: A deep learning library for solving differential equations

abstract: Deep learning has achieved remarkable success in diverse applications; however, its use in solving partial differential equations (PDEs) has emerged only recently. Here, we present an overview of physics-informed neural networks (PINNs), which embed a PDE into the loss of the neural network using automatic differentiation. The PINN algorithm is simple, and it can be applied to different types of PDEs, including integro-differential equations, fractional PDEs, and stochastic PDEs. Moreover, from the implementation point of view, PINNs solve inverse problems as easily as forward problems. We propose a new residual-based adaptive refinement (RAR) method to improve the training efficiency of PINNs. For pedagogical reasons, we compare the PINN algorithm to a standard finite element method. We also present a Python library for PINNs, DeepXDE, which is designed to serve both as an education tool to be used in the classroom as well as a research tool for solving problems in computational science and engineering. Specifically, DeepXDE can solve forward problems given initial and boundary conditions, as well as inverse problems given some extra measurements. DeepXDE supports complex-geometry domains based on the technique of constructive solid geometry, and enables the user code to be compact, resembling closely the mathematical formulation. We introduce the usage of DeepXDE and its customizability, and we also demonstrate the capability of PINNs and the user-friendliness of DeepXDE for five different examples. More broadly, DeepXDE contributes to the more rapid development of the emerging Scientific Machine Learning field.


title: Pairwise Link Prediction

abstract: Link prediction is a common problem in network science that transects many disciplines. The goal is to forecast the appearance of new links or to find links missing in the network. Typical methods for link prediction use the topology of the network to predict the most likely future or missing connections between a pair of nodes. However, network evolution is often mediated by higher-order structures involving more than pairs of nodes; for example, cliques on three nodes (also called triangles) are key to the structure of social networks, but the standard link prediction framework does not directly predict these structures. To address this gap, we propose a new link prediction task called "pairwise link prediction" that directly targets the prediction of new triangles, where one is tasked with finding which nodes are most likely to form a triangle with a given edge. We develop two PageRank-based methods for our pairwise link prediction problem and make natural extensions to existing link prediction methods. Our experiments on a variety of networks show that diffusion based methods are less sensitive to the type of graphs used and more consistent in their results. We also show how our pairwise link prediction framework can be used to get better predictions within the context of standard link prediction evaluation.


title: A Range Matching CAM for Hierarchical Defect Tolerance Technique in NRAM Structures

abstract: Due to the small size of nanoscale devices, they are highly prone to process disturbances which results in manufacturing defects. Some of the defects are randomly distributed throughout the nanodevice layer. Other disturbances tend to be local and lead to cluster defects caused by factors such as layer misintegration and line width variations. In this paper, we propose a method for identifying cluster defects from random ones. The motivation is to repair the cluster defects using rectangular ranges in a range matching content-addressable memory (RM-CAM) and random defects using triple-modular redundancy (TMR). It is believed a combination of these two approaches is more effective for repairing defects at high error rate with less resource. With the proposed fault repairing technique, defect recovery results are examined for different fault distribution scenarios. Also the mapping circuit structure required for two conceptual 32*32 and 64*64 bit RAMs are presented and their speed, power and transistor count are reported.


title: An Algorithmic Framework for Approximating Maximin Share Allocation of Chores

abstract: In this paper, we consider the problem of how to fairly dividing $m$ indivisible chores among $n$ agents. The fairness measure we considered here is the maximin share. The previous best known result is that there always exists a $\frac{4}{3}$ approximation maximin share allocation. With a novel algorithm, we can always find a $\frac{11}{9}$ approximation maximin share allocation for any instances. We also discuss how to improve the efficiency of the algorithm and its connection to the job scheduling problem.


title: Deformed Gazeau-Klauder Schr\"odinger-Cat States with Modified Commutation Relations

abstract: Generalized coherent states (GCs) under deformed quantum mechanics which exhibits intrinsic minimum length and maximum momentum have been well studied following Gazeau-Klauder approach. In this paper, as an extension to the study of quantum deformation, we investigate the famous Schrodinger cat states (SCs) under these two classes of quantum deformation. Following the concept of generalized Gazeau-Klauder Schrodinger cat states (GKSCs), we construct the deformed-GKSCs for both phenomenological models that exhibit intrinsic minimum length and (or) maximum momentum. All comparisons between minimum length and maximum momentum deformations are illustrated and plots are done in even and odd cat states since they are one of the most important classic statistical characteristics of SCs. Probability distribution and entropies are studied. In general, deformed cat states do not possess the original even and odd states statistical properties. Non-classical properties of the deformed-GKSCs are explored in terms of Mandel Q parameter, quadrature squeezing as well as Husimi quasi-probability distribution. Some of these distinguishing quantum-gravitational features may possibly be realized qualitatively and even be measured quantitatively in future experiments with the advanced development in quantum atomic and optics technology.


title: Experimental exploration of five-qubit quantum error correcting code with superconducting qubits

abstract: Quantum error correction is an essential ingredient for universal quantum computing. Despite tremendous experimental efforts in the study of quantum error correction, to date, there has been no demonstration in the realisation of universal quantum error correcting code, with the subsequent verification of all key features including the identification of an arbitrary physical error, the capability for transversal manipulation of the logical state, and state decoding. To address this challenge, we experimentally realise the $[\![5,1,3]\!]$ code, the so-called smallest perfect code that permits corrections of generic single-qubit errors. In the experiment, having optimised the encoding circuit, we employ an array of superconducting qubits to realise the $[\![5,1,3]\!]$ code for several typical logical states including the magic state, an indispensable resource for realising non-Clifford gates. The encoded states are prepared with an average fidelity of $57.1(3)\%$ while with a high fidelity of $98.6(1)\%$ in the code space. Then, the arbitrary single-qubit errors introduced manually are identified by measuring the stabilizers. We further implement logical Pauli operations with a fidelity of $97.2(2)\%$ within the code space. Finally, we realise the decoding circuit and recover the input state with an overall fidelity of $74.5(6)\%$, in total with $92$ gates. Our work demonstrates each key aspect of the $[\![5,1,3]\!]$ code and verifies the viability of experimental realization of quantum error correcting codes with superconducting qubits.


title: Restoring Images with Unknown Degradation Factors by Recurrent Use of a Multi-branch Network

abstract: The employment of convolutional neural networks has achieved unprecedented performance in the task of image restoration for a variety of degradation factors. However, high-performance networks have been specifically designed for a single degradation factor. In this paper, we tackle a harder problem, restoring a clean image from its degraded version with an unknown degradation factor, subject to the condition that it is one of the known factors. Toward this end, we design a network having multiple pairs of input and output branches and use it in a recurrent fashion such that a different branch pair is used at each of the recurrent paths. We reinforce the shared part of the network with improved components so that it can handle different degradation factors. We also propose a two-step training method for the network, which consists of multi-task learning and finetuning. The experimental results show that the proposed network yields at least comparable or sometimes even better performance on four degradation factors as compared with the best dedicated network for each of the four. We also test it on a further harder task where the input image contains multiple degradation factors that are mixed with unknown mixture ratios, showing that it achieves better performance than the previous state-of-the-art method designed for the task.


title: Multivariate Variational Mode Decomposition

abstract: In this paper, a generic extension of variational mode decomposition (VMD) algorithm for multivariate or multichannel data sets is presented. We first define a model for multivariate modulated oscillations that is based on the presence of a joint or common frequency component among all channels of input data. Using that model for multivariate oscillations, we construct a variational optimization problem that aims to extract an ensemble of band-limited modes containing inherent multivariate modulated oscillations present in multivariate input signal. The cost function to be minimized is the sum of bandwidths of all signal modes across all input data channels, which is a generic extension of the cost function used in standard VMD to multivariate data. Minimization of the resulting variational model is achieved through the alternate direction method of multipliers (ADMM) approach. That yields an optimal set of multivariate modes in terms of narrow bandwidth and corresponding center frequencies that are assumed to be commonly present among all channels of a multivariate modulated oscillation. We demonstrate the effectiveness of the proposed method through results obtained from extensive simulations involving test (synthetic) and real world multivariate data sets. Specifically, we focus on the ability of the proposed method to yield joint oscillatory modes in multivariate data which is a prerequisite in many real world applications involving nonstationary multivariate data. We also highlight the utility of the proposed method in two real world applications which include the separation of alpha rhythms in multivariate electroencephalogram (EEG) data and the decomposition of bivariate cardiotocographic signals that consist of fetal heart rate and maternal uterine contraction (FHR-UC) as its two channels.


title: Two Types of Solar Confined Flares

abstract: With the aim of understanding the physical mechanisms of confined flares, we selected 18 confined flares during 2011-2017, and classified the confined flares into two types based on their different dynamic properties and magnetic configurations. "Type I" of confined flares are characterized by slipping reconnection, strong shear, and stable filament. "Type II" flares have nearly no slipping reconnection, and have a configuration in potential state after the flare. Filament erupts but is confined by strong strapping field. "Type II" flares could be explained by 2D MHD models while "type I" flares need 3D MHD models. 7 flares of 18 ($\sim$39 \%) belong to "type I" and 11 ($\sim$61 \%) are "type II" confined flares. The post-flare loops (PFLs) of "type I" flares have a stronger non-potentiality, however, the PFLs in "type II" flares are weakly sheared. All the "type I" flares exhibit the ribbon elongations parallel to the polarity inversion line (PIL) at speeds of several tens of km s$^{-1}$. For "type II" flares, only a small proportion shows the ribbon elongations along the PIL. We suggest that different magnetic topologies and reconnection scenarios dictate the distinct properties for the two types of flares. Slipping agnetic reconnections between multiple magnetic systems result in "type I" flares. For "type II" flares, magnetic reconnections occur in anti-parallel magnetic fields underlying the erupting filament. Our study shows that "type I" flares account for more than one third of the overall large confined flares, which should not be neglected in further studies.


title: Improved Structural Methods for Nonlinear Differential-Algebraic Equations via Combinatorial Relaxation

abstract: Differential-algebraic equations (DAEs) are widely used for modeling of dynamical systems. In numerical analysis of DAEs, consistent initialization and index reduction are important preprocessing prior to numerical integration. Existing DAE solvers commonly adopt structural preprocessing methods based on combinatorial optimization. Unfortunately, the structural methods fail if the DAE has numerical or symbolic cancellations. For such DAEs, methods have been proposed to modify them to other DAEs to which the structural methods are applicable, based on the combinatorial relaxation technique. Existing modification methods, however, work only for a class of DAEs that are linear or close to linear. This paper presents two new modification methods for nonlinear DAEs: the substitution method and the augmentation method. Both methods are based on the combinatorial relaxation approach and are applicable to a large class of nonlinear DAEs. The substitution method symbolically solves equations for some derivatives based on the implicit function theorem and substitutes the solution back into the system. Instead of solving equations, the augmentation method modifies DAEs by appending new variables and equations. The augmentation method has advantages that the equation solving is not needed and the sparsity of DAEs is retained. It is shown in numerical experiments that both methods, especially the augmentation method, successfully modify high-index DAEs that the DAE solver in MATLAB cannot handle.


title: Computing Valuations of the Dieudonn\'e Determinants

abstract: This paper addresses the problem of computing valuations of the Dieudonn\'e determinants of matrices over discrete valuation skew fields (DVSFs). Under a reasonable computational model, we propose two algorithms for a class of DVSFs, called split. Our algorithms are extensions of the combinatorial relaxation of Murota (1995) and the matrix expansion by Moriyama--Murota (2013), both of which are based on combinatorial optimization. While our algorithms require an upper bound on the output, we give an estimation of the bound for skew polynomial matrices and show that the estimation is valid only for skew polynomial matrices. We consider two applications of this problem. The first one is the noncommutative weighted Edmonds' problem (nc-WEP), which is to compute the degree of the Dieudonn\'e determinants of matrices having noncommutative symbols. We show that the presented algorithms reduce the nc-WEP to the unweighted problem in polynomial time. In particular, we show that the nc-WEP over the rational field is solvable in time polynomial in the input bit-length. We also present an application to analyses of degrees of freedom of linear time-varying systems by establishing formulas on the solution spaces of linear differential/difference equations.


title: The Genesis of Magnetic Fields in White Dwarfs

abstract: Magnetic fields generated by a dynamo mechanism due to differential rotation during stellar mergers are often proposed as an explanation for the presence of strong fields in certain classes of magnetic stars, including high field magnetic white dwarfs (HFMWDs). In the case of the HFMWDs, the site of the differential rotation has been variously proposed to be the common envelope itself, the massive hot outer regions of a merged degenerate core or an accretion disc formed by a tidally disrupted companion that is subsequently incorporated into a degenerate core. In the present study I explore the possibility that the origin of HFMWDs is consistent with stellar interactions during the common envelope evolution (CEE). In this picture the observed fields are caused by an $\alpha-\Omega$ dynamo driven by differential rotation. The strongest fields would arise when the differential rotation equals the critical break up velocity and would occur from the merging of two stars during CEE or double degenerate (DD) mergers in a post common envelope (CE) stage. Those systems that do not coalesce but emerge from the CE on a close orbit and about to initiate mass transfer will evolve into magnetic cataclysmic variables (MCVs), The population synthesis calculations carried out in this work have shown that the origin of high fields in isolated white dwarfs (WDs) and in WDs in MCVs is consistent with stellar interaction during common envelope evolution. I compare the calculated field strengths to those observed and test the correlation between theory and observation by means of the Kolmogorov--Smirnov (K--S) test and show that the resulting correlation is good for values of the CE energy efficiency parameter, $\alpha{_{\rm{CE}}}$, in the range 0.1--0.3.


title: DOB-Net: Actively Rejecting Unknown Excessive Time-Varying Disturbances

abstract: This paper presents an observer-integrated Reinforcement Learning (RL) approach, called Disturbance OBserver Network (DOB-Net), for robots operating in environments where disturbances are unknown and time-varying, and may frequently exceed robot control capabilities. The DOB-Net integrates a disturbance dynamics observer network and a controller network. Originated from conventional DOB mechanisms, the observer is built and enhanced via Recurrent Neural Networks (RNNs), encoding estimation of past values and prediction of future values of unknown disturbances in RNN hidden state. Such encoding allows the controller generate optimal control signals to actively reject disturbances, under the constraints of robot control capabilities. The observer and the controller are jointly learned within policy optimization by advantage actor critic. Numerical simulations on position regulation tasks have demonstrated that the proposed DOB-Net significantly outperforms a conventional feedback controller and classical RL algorithms.


title: Alvis-Curtis Duality for Representations of Reductive Groups with Frobenius Maps

abstract: We generalize the Alvis-Curtis duality to the abstract representations of reductive groups with Frobenius maps. Similar to the case of representations of finite reductive groups, we show that the Alvis-Curtis duality of infinite type which we define in this paper also interchanges the irreducible representations in the principal representation category.


title: Error reduction in biosensors using secondary labeling

abstract: In this article, we derive the limit of detection for a two-step molecular recognition process and show that in-spite of all the recognition reactions being in equilibrium the overall error rates can be reduced exactly as much as possible in non-equilibrium methods such as kinetic proofreading.


title: Extra dimension of space-time exposed by anomalies at low energy

abstract: Recent experimental observations are shown to be quantitatively consistent with an extended concept of space-time having a discrete extra dimension of two points at the distance of 11.8 fm together with a nontrivial metric structure. In such a space-time, fermions appear in pair with their Kaluza-Klein siblings. The usual electromagnetic field is accompanied with a new vector boson $X17$, which receives a mass of $17~MeV$ from another Kaluza-Klein partner, a scalar boson $H$ of a mass in the range of $0.5-793~keV$ via an abelian Higgs mechanism. At a low energy scale, where nucleons can be treated as structureless in a good approximation, the natural particle model involving nucleons, electron, neutrino and their Kaluza-Klein partners coupled to the electromagnetic field and the massive vector boson $X7$ can lead to new phenomenological consequences, which are verifiable at the currently accessible energy.


title: Thermophysical modeling of NEOWISE observations of DESTINY+ targets Phaethon and 2005 UD

abstract: Thermophysical models allow for improved constraints on the physical and thermal surface properties of asteroids beyond what can be inferred from more simple thermal modeling, provided a sufficient number of observations is available. We present thermophysical modeling results of observations from the NEOWISE mission for two near-Earth asteroids which are the targets of the DESTINY+ flyby mission: (3200) Phaethon and (155140) 2005 UD. Our model assumes a rotating, cratered, spherical surface, and employs a Monte Carlo Markov Chain to explore the multi-dimensional parameter space of the fit. We find an effective spherical diameter for Phaethon of $4.6^{+0.2}_{-0.3}~$km, a geometric albedo of $p_V=0.16\pm0.02$, and a thermal inertia $\Gamma=880$ $^{+580}_{-330}$, using five epochs of NEOWISE observations. The best model fit for (155140) 2005 UD was less well constrained due to only having two NEOWISE observation epochs, giving a diameter of $1.2\pm0.4~$km and a geometric albedo of $p_V=0.14\pm0.09$.


title: Preferences Prediction using a Gallery of Mobile Device based on Scene Recognition and Object Detection

abstract: In this paper user modeling task is examined by processing a gallery of photos and videos on a mobile device. We propose novel engine for user preference prediction based on scene recognition, object detection and facial analysis. At first, all faces in a gallery are clustered and all private photos and videos with faces from large clusters are processed on the embedded system in offline mode. Other photos may be sent to the remote server to be analyzed by very deep models. The visual features of each photo are obtained from scene recognition and object detection models. These features are aggregated into a single user descriptor in the neural attention block. The proposed pipeline is implemented for the Android mobile platform. Experimental results with a subset of Photo Event Collection, Web Image Dataset for Event Recognition and Amazon Fashion datasets demonstrate the possibility to process images very efficiently without significant accuracy degradation. The source code of Android mobile application is publicly available at https://github.com/HSE-asavchenko/mobile-visual-preferences.


title: An elliptic partial differential equation and its application

abstract: This paper deals with the following elliptic equation \begin{equation*} -2\sigma^{2}\Delta z+\left\| \nabla z\right\| ^{2}+4\alpha z=4\left\| x\right\| ^{2}\text{ for }x\in \mathbb{R}^{N}\text{, (}% N\geq 1\text{),} \end{equation*}% where $\alpha >0,$ $\sigma>0$ are some real parameters. The solution method is based on the sub- and super-solutions approach. The case $N>1$ seemed not considered before. This equation models a stochastic production planning problem.


title: The complexity of the first-order theory of pure equality

abstract: We will find a lower bound on the recognition complexity of the theories that are nontrivial relative to some equivalence relation (this relation may be equality), namely, each of these theories is consistent with the formula, whose sense is that there exist two non-equivalent elements. However, at first, we will obtain a lower bound on the computational complexity for the first-order theory of Boolean algebra that has only two elements. For this purpose, we will code the long-continued deterministic Turing machine computations by the relatively short-length quantified Boolean formulae; the modified Stockmeyer and Meyer method will appreciably be used for this simulation. Then, we will transform the modeling formulae of the theory of this Boolean algebra to the simulation ones of the first-order theory of the only equivalence relation in polynomial time. Since the computational complexity of these theories is not polynomial, we obtain that the class $\mathbf{P}$ is a proper subclass of $\mathbf{PSPACE}$ (Polynomial Time is a proper subset of Polynomial Space). Keywords: Computational complexity, the theory of equality, the coding of computations, simulation by means formulae, polynomial time, polynomial space, lower complexity bound


title: The Shintani double zeta functions

abstract: In this paper, we give an explicit formula of the Shintani double zeta functions with any ramification in the most general setting of adeles over an arbitrary number field. Three applications of the explicit formula are given. First, we obtain a functional equation satisfied by the Shintani double zeta functions in addition to Shintani's functional equations. Second, we establish the holomorphicity of a certain Dirichlet series generalizing a result by Ibukiyama and Saito. This Dirichlet series occurs in the study of unipotent contributions of the geometric side of the Arthur-Selberg trace formula of the symplectic group. Third, we prove an asymptotic formula of the weighted average of the central values of quadratic Dirichlet $L$-functions.


title: Dual Dynamic Inference: Enabling More Efficient, Adaptive and Controllable Deep Inference

abstract: State-of-the-art convolutional neural networks (CNNs) yield record-breaking predictive performance, yet at the cost of high-energy-consumption inference, that prohibits their widely deployments in resource-constrained Internet of Things (IoT) applications. We propose a dual dynamic inference (DDI) framework that highlights the following aspects: 1) we integrate both input-dependent and resource-dependent dynamic inference mechanisms under a unified framework in order to fit the varying IoT resource requirements in practice. DDI is able to both constantly suppress unnecessary costs for easy samples, and to halt inference for all samples to meet hard resource constraints enforced; 2) we propose a flexible multi-grained learning to skip (MGL2S) approach for input-dependent inference which allows simultaneous layer-wise and channel-wise skipping; 3) we extend DDI to complex CNN backbones such as DenseNet and show that DDI can be applied towards optimizing any specific resource goals including inference latency or energy cost. Extensive experiments demonstrate the superior inference accuracy-resource trade-off achieved by DDI, as well as the flexibility to control such trade-offs compared to existing peer methods. Specifically, DDI can achieve up to 4 times computational savings with the same or even higher accuracy as compared to existing competitive baselines.


title: Two-block vs. Multi-block ADMM: An empirical evaluation of convergence

abstract: Alternating Direction Method of Multipliers (ADMM) has become a widely used optimization method for convex problems, particularly in the context of data mining in which large optimization problems are often encountered. ADMM has several desirable properties, including the ability to decompose large problems into smaller tractable sub-problems and ease of parallelization, that are essential in these scenarios. The most common form of ADMM is the two-block, in which two sets of primal variables are updated alternatingly. Recent years have seen advances in multi-block ADMM, which update more than two blocks of primal variables sequentially. In this paper, we study the empirical question: {\em Is two-block ADMM always comparable with sequential multi-block ADMM solving an equivalent problem?} In the context of optimization problems arising in multi-task learning, through a comprehensive set of experiments we surprisingly show that multi-block ADMM consistently outperformed two-block ADMM on optimization performance, and as a consequence on prediction performance, across all datasets and for the entire range of dual step sizes. Our results have an important practical implication: rather than simply using the popular two-block ADMM, one may considerably benefit from experimenting with multi-block ADMM applied to an equivalent problem.


title: Regularizing Neural Networks for Future Trajectory Prediction via Inverse Reinforcement Learning Framework

abstract: Predicting distant future trajectories of agents in a dynamic scene is not an easy problem because the future trajectory of an agent is affected by not only his/her past trajectory but also the scene contexts. To tackle this problem, we propose a model based on recurrent neural networks (RNNs) and a novel method for training the model. The proposed model is based on an encoder-decoder architecture where the encoder encodes inputs (past trajectories and scene context information) while the decoder produces a trajectory from the context vector given by the encoder. We train the networks of the proposed model to produce a future trajectory, which is the closest to the true trajectory, while maximizing a reward from a reward function. The reward function is also trained at the same time to maximize the margin between the rewards from the ground-truth trajectory and its estimate. The reward function plays the role of a regularizer for the proposed model so the trained networks are able to better utilize the scene context information for the prediction task. We evaluated the proposed model on several public datasets. Experimental results show that the prediction performance of the proposed model is much improved by the regularization, which outperforms the-state-of-the-arts in terms of accuracy. The implementation codes are available at https://github.com/d1024choi/traj-pred-irl/.


title: Analysis and Simulation of a Coupled Diffusion based Image Denoising Model

abstract: In this study, a new coupled Partial Differential Equation (CPDE) based image denoising model incorporating space-time regularization into non-linear diffusion is proposed. This proposed model is fitted with additive Gaussian noise which performs efficient image smoothing along with the preservation of edges and fine structures. For this purpose, we propose a new functional minimization framework to remove the image noise, which results in solving a system of three partial differential equations (PDEs). Our proposed model is dissimilar from the existing CPDE models as it includes two additional evolution equations to handle edge strength function and data fidelity term. These two evolution equations control the smoothing process and force the resultant denoised solution to be close to the initial solution. To the best of our knowledge, the proposed model is the only work, which deciphers the combined effect of both the terms using separate PDEs. Furthermore, we establish the existence and uniqueness of a weak solution of the proposed system using the time discretization method with $H^1$ initial data. Finally, we used a generalized weighted average finite difference scheme to efficiently solve the coupled system and experiment results show the effectiveness of the proposed CPDE model.


title: Dynamics of Team Library Adoptions: An Exploration of GitHub Commit Logs

abstract: When a group of people strives to understand new information, struggle ensues as various ideas compete for attention. Steep learning curves are surmounted as teams learn together. To understand how these team dynamics play out in software development, we explore Git logs, which provide a complete change history of software repositories. In these repositories, we observe code additions, which represent successfully implemented ideas, and code deletions, which represent ideas that have failed or been superseded. By examining the patterns between these commit types, we can begin to understand how teams adopt new information. We specifically study what happens after a software library is adopted by a project, i.e., when a library is used for the first time in the project. We find that a variety of factors, including team size, library popularity, and prevalence on Stack Overflow are associated with how quickly teams learn and successfully adopt new software libraries.


title: A note on the boundary behaviour of the squeezing function and Fridman invariant

abstract: Let $\Omega$ be a domain in $\mathbb C^n$. Suppose that $\partial\Omega$ is smooth pseudoconvex of D'Angelo finite type near a boundary point $\xi_0\in \partial\Omega$ and the Levi form has corank at most $1$ at $\xi_0$. Our goal is to show that if the squeezing function $s_\Omega(\eta_j)$ tends to $1$ or the Fridman invariant $h_\Omega(\eta_j)$ tends to $0$ for some sequence $\{\eta_j\}\subset \Omega$ converging to $\xi_0$, then this point must be strongly pseudoconvex.


title: Bayesian Inference for Regression Copulas

abstract: We propose a new semi-parametric distributional regression smoother that is based on a copula decomposition of the joint distribution of the vector of response values. The copula is high-dimensional and constructed by inversion of a pseudo regression, where the conditional mean and variance are semi-parametric functions of covariates modeled using regularized basis functions. By integrating out the basis coefficients, an implicit copula process on the covariate space is obtained, which we call a `regression copula'. We combine this with a non-parametric margin to define a copula model, where the entire distribution - including the mean and variance - of the response is a smooth semi-parametric function of the covariates. The copula is estimated using both Hamiltonian Monte Carlo and variational Bayes; the latter of which is scalable to high dimensions. Using real data examples and a simulation study we illustrate the efficacy of these estimators and the copula model. In a substantive example, we estimate the distribution of half-hourly electricity spot prices as a function of demand and two time covariates using radial bases and horseshoe regularization. The copula model produces distributional estimates that are locally adaptive with respect to the covariates, and predictions that are more accurate than those from benchmark models.


title: Bayesian Variable Selection for Non-Gaussian Responses: A Marginally Calibrated Copula Approach

abstract: We propose a new highly flexible and tractable Bayesian approach to undertake variable selection in non-Gaussian regression models. It uses a copula decomposition for the joint distribution of observations on the dependent variable. This allows the marginal distribution of the dependent variable to be calibrated accurately using a nonparametric or other estimator. The family of copulas employed are `implicit copulas' that are constructed from existing hierarchical Bayesian models widely used for variable selection, and we establish some of their properties. Even though the copulas are high-dimensional, they can be estimated efficiently and quickly using Markov chain Monte Carlo (MCMC). A simulation study shows that when the responses are non-Gaussian the approach selects variables more accurately than contemporary benchmarks. A real data example in the Web Appendix illustrates that accounting for even mild deviations from normality can lead to a substantial increase in accuracy. To illustrate the full potential of our approach we extend it to spatial variable selection for fMRI. Using real data, we show our method allows for voxel-specific marginal calibration of the magnetic resonance signal at over 6,000 voxels, leading to an increase in the quality of the activation maps.


title: Formal expansions in stochastic model for wave turbulence 1: kinetic limit

abstract: We consider the damped/driver (modified) cubic NLS equation on a large torus with a properly scaled forcing and dissipation, and decompose its solutions to formal series in the amplitude. We study the second order truncation of this series and prove that when the amplitude goes to zero and the torus' size goes to infinity the energy spectrum of the truncated solutions becomes close to a solution of the damped/driven wave kinetic equation. Next we discuss higher order truncations of the series.


title: Magneto-Crystalline Anisotropy of Fe, Co and Ni slabs from Density Functional Theory and Tight-Binding models

abstract: We report magneto-crystalline anisotropy (MCA) calculations of Fe, Co and Ni slabs of various thicknesses and crystallographic orientations from two Density Functional Theory codes based either on a plane wave or a local atomic basis set expansion and a magnetic tight-binding method. We analyze the evolution of the MCA with the number of layers of the slabs. The decomposition of MCA into contributions of atomic sites helps understanding the oscillatory behaviour of the MCA with the slab thickness and highlights the role of finite size effects. We also identify some specific systems with enhanced MCA. A k-space as well as a band-filling analysis show very rich features of the MCA that could be used to tailor systems with enhanced magnetic properties. Finally this work can serve as a benchmark for MCA calculations.


title: Polarisation control for optical nanofibres by imaging through a single lens

abstract: We present a simple method for controlling the polarisation state of light at the waist of a single-mode optical nanofibre. The method consists of complete polarisation compensation based on imaging scattered light from inherent inhomogeneities both on the fibre surface and in the glass material itself. In contrast to the recently reported protocol exploiting two imaging systems oriented at 45 degrees to each other, our method requires only one lens and a video camera. It is particularly useful for nanofibre-based applications with severe geometric constraints, such as inside vacuum chambers for experiments with cold atoms. The measured fidelity of the achieved control is about 98\% using lenses with moderate numerical apertures.


title: The Role of Cooperation in Responsible AI Development

abstract: In this paper, we argue that competitive pressures could incentivize AI companies to underinvest in ensuring their systems are safe, secure, and have a positive social impact. Ensuring that AI systems are developed responsibly may therefore require preventing and solving collective action problems between companies. We note that there are several key factors that improve the prospects for cooperation in collective action problems. We use this to identify strategies to improve the prospects for industry cooperation on the responsible development of AI.


title: On general position sets in Cartesian products

abstract: The general position number ${\rm gp}(G)$ of a connected graph $G$ is the cardinality of a largest set $S$ of vertices such that no three distinct vertices from $S$ lie on a common geodesic; such sets are refereed to as gp-sets of $G$. The general position number of cylinders $P_r\,\square\, C_s$ is deduced. It is proved that ${\rm gp}(C_r\,\square\, C_s)\in \{6,7\}$ whenever $r\ge s \ge 3$, $s\ne 4$, and $r\ge 6$. A probabilistic lower bound on the general position number of Cartesian graph powers is achieved. Along the way a formula for the number of gp-sets in $P_r\,\square\, P_s$, where $r,s\ge 2$, is also determined.


title: Multi-layer Attention Mechanism for Speech Keyword Recognition

abstract: As an important part of speech recognition technology, automatic speech keyword recognition has been intensively studied in recent years. Such technology becomes especially pivotal under situations with limited infrastructures and computational resources, such as voice command recognition in vehicles and robot interaction. At present, the mainstream methods in automatic speech keyword recognition are based on long short-term memory (LSTM) networks with attention mechanism. However, due to inevitable information losses for the LSTM layer caused during feature extraction, the calculated attention weights are biased. In this paper, a novel approach, namely Multi-layer Attention Mechanism, is proposed to handle the inaccurate attention weights problem. The key idea is that, in addition to the conventional attention mechanism, information of layers prior to feature extraction and LSTM are introduced into attention weights calculations. Therefore, the attention weights are more accurate because the overall model can have more precise and focused areas. We conduct a comprehensive comparison and analysis on the keyword spotting performances on convolution neural network, bi-directional LSTM cyclic neural network, and cyclic neural network with the proposed attention mechanism on Google Speech Command datasets V2 datasets. Experimental results indicate favorable results for the proposed method and demonstrate the validity of the proposed method. The proposed multi-layer attention methods can be useful for other researches related to object spotting.


title: Heuristic construction of codeword stabilized codes

abstract: The family of codeword stabilized codes encompasses the stabilizer codes as well as many of the best known nonadditive codes. However, constructing optimal $n$-qubit codeword stabilized codes is made difficult by two main factors. The first of these is the exponential growth with $n$ of the number of graphs on which a code can be based. The second is the NP-hardness of the maximum clique search required to construct a code from a given graph. We address the second of these issues through the use of a heuristic clique finding algorithm. This approach has allowed us to find $((9,97\leq K\leq100,2))$ and $((11,387\leq K\leq416,2))$ codes, which are larger than any previously known codes. To address the exponential growth of the search space, we demonstrate that graphs that give large codes typically yield clique graphs with a large number of nodes. The number of such nodes can be determined relatively efficiently, and we demonstrate that $n$-node graphs yielding large clique graphs can be found using a genetic algorithm. This algorithm uses a novel spectral bisection based crossover operation that we demonstrate to be superior to more standard crossover operations. Using this genetic algorithm approach, we have found $((13,18,4))$ and $((13,20,4))$ codes that are larger than any previously known code. We also consider codes for the amplitude damping channel. We demonstrate that for $n\leq9$, optimal codeword stabilized codes correcting a single amplitude damping error can be found by considering standard form codes that detect one of only three of the $3^{n}$ possible equivalent error sets. By combining this error set selection with the genetic algorithm approach, we have found $((11,68))$ and $((11,80))$ codes capable of correcting a single amplitude damping error and $((11,4))$, $((12,4))$, $((13,8))$, and $((14,16))$ codes capable of correcting two amplitude damping


title: Generalized substantial fractional operators and well-posedness of Cauchy problem

abstract: In this work we focus on substantial fractional integral and differential operators which play an important role in modeling anomalous diffusion. We introduce a new generalized substantial fractional integral. Generalizations of fractional substantial derivatives are also introduced both in Riemann-Liouville and Caputo sense. Furthermore, we analyze fundamental properties of these operators. Finally, we consider a class of generalized substantial fractional differential equations and discuss the existence, uniqueness and continuous dependence of solutions on initial data.


title: Simple Kinematic Feedback Enhances Autonomous Learning in Bio-Inspired Tendon-Driven Systems

abstract: Error feedback is known to improve performance by correcting control signals in response to perturbations. Here we show how adding simple error feedback can also accelerate and robustify autonomous learning in a tendon-driven robot. We implemented two versions of the General-to-Particular (G2P) autonomous learning algorithm to produce multiple movement tasks using a tendon-driven leg with two joints and three tendons: one with and one without kinematic feedback. As expected, feedback improved performance in simulation and hardware. However, we see these improvements even in the presence of sensory delays of up to 100 ms and when experiencing substantial contact collisions. Importantly, feedback accelerates learning and enhances G2P's continual refinement of the initial inverse map by providing the system with more relevant data to train on. This allows the system to perform well even after only 60 seconds of initial motor babbling.


title: Temperature dependence of magnetic resonance in ferrimagnetic GdFeCo alloys

abstract: We provide a macroscopic theory and experimental results for magnetic resonances of antiferromagnetically-coupled ferrimagnets. Our theory, which interpolates the dynamics of antiferromagnets and ferromagnets smoothly, can describe ferrimagnetic resonances across the angular momentum compensation point. We also present experimental results for spin-torque induced ferrimagnetic resonance at several temperatures. The spectral analysis based on our theory reveals that the Gilbert damping parameter, which has been considered to be strongly temperature dependent, is insensitive to temperature. We envision that our work will facilitate further investigation of ferrimagnetic dynamics by providing a theoretical framework suitable for a broad range of temperatures.


title: On Laplace transforms with respect to functions and their applications to fractional differential equations

abstract: An important class of fractional differential and integral operators is given by the theory of fractional calculus with respect to functions, sometimes called $\Psi$-fractional calculus. The operational calculus approach has proved useful for understanding and extending this topic of study. Motivated by fractional differential equations, we present an operational calculus approach for Laplace transforms with respect to functions and their relationship with fractional operators with respect to functions. This approach makes the generalised Laplace transforms much easier to analyse and to apply in practice. We prove several important properties of these generalised Laplace transforms, including an inversion formula, and apply it to solve some fractional differential equations, using the operational calculus approach for efficient solving.


title: Two species nonlocal diffusion systems with free boundaries

abstract: We study a class of free boundary systems with nonlocal diffusion, which are natural extensions of the corresponding free boundary problems of reaction diffusion systems. As before the free boundary represents the spreading front of the species, but here the population dispersal is described by "nonlocal diffusion" instead of "local diffusion". We prove that such a nonlocal diffusion problem with free boundary has a unique global solution, and for models with Lotka-Volterra type competition or predator-prey growth terms, we show that a spreading-vanishing dichotomy holds, and obtain criteria for spreading and vanishing; moreover, for the weak competition case and for the weak predation case, we can determine the long-time asymptotic limit of the solution when spreading happens. Compared with the single species free boundary model with nonlocal diffusion considered recently in \cite{CDLL}, and the two species cases with local diffusion extensively studied in the literature, the situation considered in this paper involves several extra difficulties, which are overcome by the use of some new techniques.


title: An Optimistic Perspective on Offline Reinforcement Learning

abstract: Off-policy reinforcement learning (RL) using a fixed offline dataset of logged interactions is an important consideration in real world applications. This paper studies offline RL using the DQN replay dataset comprising the entire replay experience of a DQN agent on 60 Atari 2600 games. We demonstrate that recent off-policy deep RL algorithms, even when trained solely on this fixed dataset, outperform the fully trained DQN agent. To enhance generalization in the offline setting, we present Random Ensemble Mixture (REM), a robust Q-learning algorithm that enforces optimal Bellman consistency on random convex combinations of multiple Q-value estimates. Offline REM trained on the DQN replay dataset surpasses strong RL baselines. Ablation studies highlight the role of offline dataset size and diversity as well as the algorithm choice in our positive results. Overall, the results here present an optimistic view that robust RL algorithms trained on sufficiently large and diverse offline datasets can lead to high quality policies. The DQN replay dataset can serve as an offline RL benchmark and is open-sourced.


title: On-chip mid-infrared and THz frequency combs for spectroscopy

abstract: Frequency combs have revolutionized time and frequency metrology and in recent years, new frequency comb lasers that are highly compact or even on-chip have been demonstrated in the mid-infrared and THz regions of the electromagnetic spectrum. The emerging technologies include electrically pumped quantum and interband cascade semiconductor devices, as well as high-quality factor microresonators. In this guest editorial, the authors summarize recent advances in the field, the potential for rapid broadband spectroscopy, as well as the challenges and prospects for use in molecular gas sensing.


title: Tuning the Effective PT-Phase of Plasmonic Eigenmodes

abstract: We experimentally observe an effective PT-phase transition through the exceptional point in a hybrid plasmonic-dielectric waveguide system. Transmission experiments reveal fundamental changes in the underlying Eigenmode interactions as the environmental refractive index is tuned, which can be unambiguously attributed to a crossing through the plasmonic exceptional point. These results extend the design opportunities for tuneable non-Hermitian physics to plasmonic systems.


title: Integrated on chip platform with quantum emitters in layered materials

abstract: Integrated quantum photonic circuitry is an emerging topic that requires efficient coupling of quantum light sources to waveguides and optical resonators. So far, great effort has been devoted to engineering on-chip systems from three-dimensional crystals such as diamond or gallium arsenide. In this study, we demonstrate room temperature coupling of quantum emitters embedded within a layered hexagonal boron nitride to an on-chip aluminium nitride waveguide. We achieved 1.2% light coupling efficiency of the device and realise transmission of single photons through the waveguide. Our results serve as a foundation for the integration of layered materials with on-chip components and for the realisation of integrated quantum photonic circuitry.


title: Derivation of the 2d Gross-Pitaevskii equation for strongly confined 3d bosons

abstract: We study the dynamics of a system of $N$ interacting bosons in a disc-shaped trap, which is realised by an external potential that confines the bosons in one spatial dimension to a region of order $\varepsilon$. The interaction is non-negative and scaled in such a way that its scattering length is of order $(N/\varepsilon)^{-1}$, while its range is proportional to $(N/\varepsilon)^{-\beta}$ with scaling parameter $\beta\in(0,1]$. We consider the simultaneous limit $(N,\varepsilon)\to(\infty,0)$ and assume that the system initially exhibits Bose-Einstein condensation. We prove that condensation is preserved by the $N$-body dynamics, where the time-evolved condensate wave function is the solution of a two-dimensional non-linear equation. The strength of the non-linearity depends on the scaling parameter $\beta$. For $\beta\in(0,1)$, we obtain a cubic defocusing non-linear Schr\"odinger equation, while the choice $\beta=1$ yields a Gross-Pitaevskii equation featuring the scattering length of the interaction. In both cases, the coupling parameter depends on the confining potential.


title: Steepest Entropy Ascent Solution for a Continuous-Time Quantum Walker

abstract: We consider the steepest entropy ascent (SEA) ansatz to describe the non-linear thermodynamic evolution of a quantum system. Recently this principle has been dubbed the fourth law of thermodynamics (Beretta Gian Paolo. 2020 The fourth law of thermodynamics: steepest entropy ascent). A unique global equilibrium state exists in this context, and any other state is driven by the maximum entropy generation principle towards this equilibrium. We study the SEA evolution of a continuous-time quantum walker (CTQW) on a cycle graph with N nodes. SEA solutions are difficult to find analytically. We provide an approximate scheme to find a general single-particle evolution equation governed by the SEA principle, whose solution produces dissipation dynamics. We call this scheme fixed Lagrange's multiplier (FLM) method. In the Bloch sphere representation, we find trajectories traced out by the Bloch vector within the sphere itself. We have discussed these trajectories under various initial conditions for the case of a qubit. A similar dissipative motion is also observed in the case of CTQW, where probability amplitudes have been used to characterize decoherence. Our FLM scheme shows good agreement with numerical results. As reported in the text, in CTQW, a strong delocalization exists for low system relaxation time.


title: Symmetric div-quasiconvexity and the relaxation of static problems

abstract: We consider problems of static equilibrium in which the primary unknown is the stress field and the solutions maximize a complementary energy subject to equilibrium constraints. A necessary and sufficient condition for the sequential lower-semicontinuity of such functionals is symmetric ${\rm div}$-quasiconvexity, a special case of Fonseca and M\"uller's $A$-quasiconvexity with $A = {\rm div}$ acting on $R^{n\times n}_{sym}$. We specifically consider the example of the static problem of plastic limit analysis and seek to characterize its relaxation in the non-standard case of a non-convex elastic domain. We show that the symmetric ${\rm div}$-quasiconvex envelope of the elastic domain can be characterized explicitly for isotropic materials whose elastic domain depends on pressure $p$ and Mises effective shear stress $q$. The envelope then follows from a rank-$2$ hull construction in the $(p,q)$-plane. Remarkably, owing to the equilibrium constraint the relaxed elastic domain can still be strongly non-convex, which shows that convexity of the elastic domain is not a requirement for existence in plasticity.


title: Symmetry-Protected Degeneracies in the Electronic Band Structure of Oxidized Black Phosphorous

abstract: We explore the oxidation of a single layer of black phosphorous using ab initio density functional theory calculation. We search for the equilibrium structures of phosphorene oxides, PO$_x$ with various oxygen concentrations $x$ ($0{\le}x{\le}1$). By evaluating the formation energies with diverse configurations and their vibrational properties for each of various $x$ values, we identify a series of stable oxidized structures with $x$ and confirm that the oxidation occurs naturally. We also find that oxidation makes some modes from the P-O bonds P-P bonds IR-active implying that the infrared spectra can be used to determine the degree of oxidation of phosphorene. Our electronic structure calculation reveals that the fully oxidized phosphorene (PO) has a direct band gap of 0.83 eV similar to the pristine phosphorene. Intriguingly, the PO possesses two nonsymmorphic symmetries with the inversion symmetry broken, guaranteeing a symmetry-protected band structures including the band degeneracy and four-fold degenerate Dirac points. Our results may provide a significant insight into the intriguing relations between symmetry of lattice and band topology of electrons.


title: Tempered and Hadamard-type fractional calculus with respect to functions

abstract: Many different types of fractional calculus have been defined, which may be categorised into broad classes according to their properties and behaviours. Two types that have been much studied in the literature are the Hadamard-type fractional calculus and tempered fractional calculus. This paper establishes a connection between these two definitions, writing one in terms of the other by making use of the theory of fractional calculus with respect to functions. By extending this connection in a natural way, a generalisation is developed which unifies several existing fractional operators: Riemann--Liouville, Caputo, classical Hadamard, Hadamard-type, tempered, and all of these taken with respect to functions. The fundamental calculus of these generalised operators is established, including semigroup and reciprocal properties as well as application to some example functions. Function spaces are constructed in which the new operators are defined and bounded. Finally, some formulae are derived for fractional integration by parts with these operators.


title: Mechanism for a Chemical Potential of Nonequilibrium Magnons in Parametric Parallel Pumping

abstract: We demonstrate how a magnon chemical potential is generated in parametric parallel pumping. We study how a time-periodic magnetic field of this pumping affects magnon properties of a ferrimagnet in a nonequilibrium steady state. We show that the magnon distribution function of our nonequilibrium steady state becomes the Bose distribution function with $\mu=\omega_{\textrm{p}}/2$, where $\mu$ is the magnon chemical potential and $\omega_{\textrm{p}}$ is the pumping frequency. This result is distinct from the absence of the magnon chemical potential in the standard theory and can qualitatively explain its generation in experiments. We believe our result is a first theoretical demonstration of the generation of the magnon chemical potential in the parametric parallel pumping, providing an important step towards a thorough understanding of properties of nonequilibrium magnons.


title: Neural Reasoning, Fast and Slow, for Video Question Answering

abstract: What does it take to design a machine that learns to answer natural questions about a video? A Video QA system must simultaneously understand language, represent visual content over space-time, and iteratively transform these representations in response to lingual content in the query, and finally arriving at a sensible answer. While recent advances in lingual and visual question answering have enabled sophisticated representations and neural reasoning mechanisms, major challenges in Video QA remain on dynamic grounding of concepts, relations and actions to support the reasoning process. Inspired by the dual-process account of human reasoning, we design a dual process neural architecture, which is composed of a question-guided video processing module (System 1, fast and reactive) followed by a generic reasoning module (System 2, slow and deliberative). System 1 is a hierarchical model that encodes visual patterns about objects, actions and relations in space-time given the textual cues from the question. The encoded representation is a set of high-level visual features, which are then passed to System 2. Here multi-step inference follows to iteratively chain visual elements as instructed by the textual elements. The system is evaluated on the SVQA (synthetic) and TGIF-QA datasets (real), demonstrating competitive results, with a large margin in the case of multi-step reasoning.


title: Finding Robust Periodic Timetables by Integrating Delay Management

abstract: This paper defines and solves a mathematical model for finding robust periodic timetables by proposing an extension of the Periodic Event Scheduling Problem (PESP). In order to model delayed and not nominal travel times already in the timetabling step, we integrate delay management into the periodic timetabling problem. After revisiting both (PESP) and delay management individually, we introduce a periodic delay management model capable of evaluating periodic timetables with respect to delay resistance. Having introduced periodic delay management, we define the Robust Periodic Timetabling problem (RPT). Due to the high complexity of (RPT) we propose two different simplifications of the problem and introduce solution algorithms for both of them. These solution algorithms are tested against timetables found by standard procedures for periodic timetabling with respect to their delay-resistance. The computational results show that our algorithms yield timetables which can cope better with occurring delays, even on large-scale datasets and with low computational effort.