title: Applications of the Free Energy Principle to Machine Learning and Neuroscience

abstract: In this PhD thesis, we explore and apply methods inspired by the free energy principle to two important areas in machine learning and neuroscience. The free energy principle is a general mathematical theory of the necessary information-theoretic behaviours of systems that maintain a separation from their environment. A core postulate of the theory is that complex systems can be seen as performing variational Bayesian inference and minimizing an information-theoretic quantity called the variational free energy. The thesis is structured into three independent sections. Firstly, we focus on predictive coding, a neurobiologically plausible process theory derived from the free energy principle which argues that the primary function of the brain is to minimize prediction errors, showing how predictive coding can be scaled up and extended to be more biologically plausible, and elucidating its close links with other methods such as Kalman Filtering. Secondly, we study active inference, a neurobiologically grounded account of action through variational message passing, and investigate how these methods can be scaled up to match the performance of deep reinforcement learning methods. We additionally provide a detailed mathematical understanding of the nature and origin of the information-theoretic objectives that underlie exploratory behaviour. Finally, we investigate biologically plausible methods of credit assignment in the brain. We first demonstrate a close link between predictive coding and the backpropagation of error algorithm. We go on to propose novel and simpler algorithms which allow for backprop to be implemented in purely local, biologically plausible computations.


title: Initial Results from the LIGO Newtonian Calibrator

abstract: The precise calibration of the strain readout of the LIGO gravitational wave observatories is paramount to the accurate interpretation of gravitational wave events. This calibration is traditionally done by imparting a known force on the test masses of the observatory via radiation pressure. Here we describe the implementation of an alternative calibration scheme: the Newtonian Calibrator. This system uses a rotor consisting of both quadrupole and hexapole mass distributions to apply a time-varying gravitational force on one of the observatory's test masses. The force produced by this rotor can be predicted to $<1\%$ relative uncertainty and is well-resolved in the readout of the observatory. This system currently acts as a cross-check of the existing absolute calibration system.


title: Local positional and spin symmetry breaking as a source of magnetism and insulation in paramagnetic EuTiO3

abstract: We consider theoretically the paramagnetic phases of EuTiO3 that represent configurations created by two sets of microscopic degrees of freedom (m-DOF): positional symmetry breaking due to octahedral rotations and magnetic symmetry breaking due to spin disorder. The effect of these sets of m-DOFs on the electronic structure and properties of the para phases is assessed by considering sufficiently large (super) cells with the required nominal global average symmetry, allowing, however, the local positional and magnetic symmetries to be lowered. We find that tendencies for local symmetry breaking can be monitored by following total energy lowering in mean-field like density functional theory, without recourse for strong correlation effects. While most nominally cubic ABO3 perovskites are known for their symmetry breaking due to the B-atom sublattice, the case of f-electron magnetism in EuTiO3 is associated with A- sublattice symmetry breaking and its coupling to structural distortions. We find that (i) paramagnetic cubic EuTiO3 has an intrinsic tendency for both magnetic and positional symmetry breaking, while paramagnetic tetragonal EuTiO3 has only magnetic symmetry lowering and no noticeable positional symmetry lowering with respect to low-temperature antiferromagnetic tetragonal phase. (ii) Properly modeled paramagnetic tetragonal and cubic EuTiO3 have a nonzero local magnetic moment on each Eu ion, consistent with the experimental observations of local magnetism in the para phases of EuTiO3 significantly above the N\'eel temperature. Interestingly, (iii) the local positional distortion modes in the short-range ordered para phases are inherited from the long-range ordered low-temperature antiferromagnetic ground state phase.


title: One-class Steel Detector Using Patch GAN Discriminator for Visualising Anomalous Feature Map

abstract: For steel product manufacturing in indoor factories, steel defect detection is important for quality control. For example, a steel sheet is extremely delicate, and must be accurately inspected. However, to maintain the painted steel parts of the infrastructure around a severe outdoor environment, corrosion detection is critical for predictive maintenance. In this paper, we propose a general-purpose application for steel anomaly detection that consists of the following four components. The first, a learner, is a unit image classification network to determine whether the region of interest or background has been recognised, after dividing the original large sized image into 256 square unit images. The second, an extractor, is a discriminator feature encoder based on a pre-trained steel generator with a patch generative adversarial network discriminator(GAN). The third, an anomaly detector, is a one-class support vector machine(SVM) to predict the anomaly score using the discriminator feature. The fourth, an indicator, is an anomalous probability map used to visually explain the anomalous features. Furthermore, we demonstrated our method through the inspection of steel sheet defects with 13,774 unit images using high-speed cameras, and painted steel corrosion with 19,766 unit images based on an eye inspection of the photographs. Finally, we visualise anomalous feature maps of steel using a strip and painted steel inspection dataset


title: Greedy Decentralized Auction-based Task Allocation for Multi-Agent Systems

abstract: We propose a decentralized auction-based algorithm for the solution of dynamic task allocation problems for spatially distributed multi-agent systems. In our approach, each member of the multi-agent team is assigned to at most one task from a set of spatially distributed tasks, while several agents can be allocated to the same task. The task assignment is dynamic since it is updated at discrete time stages (iterations) to account for the current states of the agents as the latter move towards the tasks assigned to them at the previous stage. Our proposed methods can find applications in problems of resource allocation by intelligent machines such as the delivery of packages by a fleet of unmanned or semi-autonomous aerial vehicles. In our approach, the task allocation accounts for both the cost incurred by the agents for the completion of their assigned tasks (e.g., energy or fuel consumption) and the rewards earned for their completion (which may reflect, for instance, the agents' satisfaction). We propose a Greedy Coalition Auction Algorithm (GCAA) in which the agents possess bid vectors representing their best evaluations of the task utilities. The agents propose bids, deduce an allocation based on their bid vectors and update them after each iteration. The solution estimate of the proposed task allocation algorithm converges after a finite number of iterations which cannot exceed the number of agents. Finally, we use numerical simulations to illustrate the effectiveness of the proposed task allocation algorithm (in terms of performance and computation time) in several scenarios involving multiple agents and tasks distributed over a spatial 2D domain.


title: Improved Analysis of Online Balanced Clustering

abstract: In the online balanced graph repartitioning problem, one has to maintain a clustering of $n$ nodes into $\ell$ clusters, each having $k = n / \ell$ nodes. During runtime, an online algorithm is given a stream of communication requests between pairs of nodes: an inter-cluster communication costs one unit, while the intra-cluster communication is free. An algorithm can change the clustering, paying unit cost for each moved node. This natural problem admits a simple $O(\ell^2 \cdot k^2)$-competitive algorithm COMP, whose performance is far apart from the best known lower bound of $\Omega(\ell \cdot k)$. One of open questions is whether the dependency on $\ell$ can be made linear; this question is of practical importance as in the typical datacenter application where virtual machines are clustered on physical servers, $\ell$ is of several orders of magnitude larger than $k$. We answer this question affirmatively, proving that a simple modification of COMP is $(\ell \cdot 2^{O(k)})$-competitive. On the technical level, we achieve our bound by translating the problem to a system of linear integer equations and using Graver bases to show the existence of a ``small'' solution.


title: Behaviour of FWER in Normal Distributions

abstract: Familywise error rate (FWER) has been a cornerstone in simultaneous inference for decades, and the classical Bonferroni method has been one of the most prominent frequentist approaches for controlling FWER. The present article studies the behavior of the FWER for Bonferroni procedure in a multiple testing problem. We establish upper bounds on FWER for Bonferroni method under the equicorrelated and general normal setups in nonasymptotic case.


title: Nonlinear input transformations are ubiquitous in quantum reservoir computing

abstract: The nascent computational paradigm of quantum reservoir computing presents an attractive use of near-term, noisy-intermediate-scale quantum processors. To understand the potential power and use cases of quantum reservoir computing, it is necessary to define a conceptual framework to separate its constituent components and determine their impacts on performance. In this manuscript, we utilize such a framework to isolate the input encoding component of contemporary quantum reservoir computing schemes. We find that across the majority of schemes the input encoding implements a nonlinear transformation on the input data. As nonlinearity is known to be a key computational resource in reservoir computing, this calls into question the necessity and function of further, post-input, processing. Our findings will impact the design of future quantum reservoirs, as well as the interpretation of results and fair comparison between proposed designs.


title: Wave-Driven Torques to Drive Current and Rotation

abstract: In the classic Landau damping initial value problem, where a planar electrostatic wave transfers energy and momentum to resonant electrons, a recoil reaction occurs in the nonresonant particles to ensure momentum conservation. To explain how net current can be driven in spite of this conservation, the literature often appeals to mechanisms that transfer this nonresonant recoil momentum to ions, which carry negligible current. However, this explanation does not allow the transport of net charge across magnetic field lines, precluding ExB rotation drive. Here, we show that in steady state, this picture of current drive is incomplete. Using a simple Fresnel model of the plasma, we show that for lower hybrid waves, the electromagnetic energy flux (Poynting vector) and momentum flux (Maxwell stress tensor) associated with the evanescent vacuum wave, become the Minkowski energy flux and momentum flux in the plasma, and are ultimately transferred to resonant particles. Thus, the torque delivered to the resonant particles is ultimately supplied by the electromagnetic torque from the antenna, allowing the nonresonant recoil response to vanish and rotation to be driven. We present a warm fluid model that explains how this momentum conservation works out locally, via a Reynolds stress that does not appear in the 1D initial value problem. This model is the simplest that can capture both the nonresonant recoil reaction in the initial-value problem, and the absence of a nonresonant recoil in the steady-state boundary value problem, thus forbidding rotation drive in the former while allowing it in the latter.


title: Measurement of a helium tune-out frequency: an independent test of quantum electrodynamics

abstract: Despite quantum electrodynamics (QED) being one of the most stringently tested theories underpinning modern physics, recent precision atomic spectroscopy measurements have uncovered several small discrepancies between experiment and theory. One particularly powerful experimental observable that tests QED independently of traditional energy level measurements is the `tune-out' frequency, where the dynamic polarizability vanishes and the atom does not interact with applied laser light. In this work, we measure the `tune-out' frequency for the $2^{3\!}S_1$ state of helium between transitions to the $2^{3\!}P$ and $3^{3\!}P$ manifolds and compare it to new theoretical QED calculations. The experimentally determined value of $725\,736\,700\,$$(40_{\mathrm{stat}},260_{\mathrm{syst}})$ MHz is within ${\sim} 1.7\sigma$ of theory ($725\,736\,252(9)$ MHz), and importantly resolves both the QED contributions (${\sim} 30 \sigma$) and novel retardation (${\sim} 2 \sigma$) corrections.


title: Origin of Nonlinear Damping due to Mode Coupling in Auto-Oscillatory Modes Strongly Driven by Spin-Orbit Torque

abstract: We investigate the physical origin of nonlinear damping due to mode coupling between several auto-oscillatory modes driven by spin-orbit torque in constricted Py/Pt heterostructures by examining the dependence of auto-oscillation on temperature and applied field orientation. We observe a transition in the nonlinear damping of the auto-oscillation modes extracted from the total oscillation power as a function of drive current, which coincides with the onset of power redistribution amongst several modes and the crossover from linewidth narrowing to linewidth broadening in all individual modes. This indicates the activation of another relaxation process by nonlinear magnon-magnon scattering within the modes. We also find that both nonlinear damping and threshold current in the mode-interaction damping regime at high drive current after transition are temperature independent, suggesting that the mode coupling occurs dominantly through a non-thermal magnon scattering process via a dipole or exchange interaction rather than thermally excited magnon-mediated scattering. This finding presents a promising pathway to overcome the current limitations of efficiently controlling the interaction between two highly nonlinear magnetic oscillators to prevent mode crosstalk or inter-mode energy transfer and deepens understanding of complex nonlinear spin dynamics in multimode spin wave systems.


title: Intelligent Anomaly Mitigation in Cyber-Physical Inverter-based Systems

abstract: The distributed cooperative controllers for inverter-based systems rely on communication networks that make them vulnerable to cyber anomalies. In addition, the distortion effects of such anomalies may also propagate throughout inverter-based cyber-physical systems due to the cooperative cyber layer. In this paper, an intelligent anomaly mitigation technique for such systems is presented utilizing data driven artificial intelligence tools that employ artificial neural networks. The proposed technique is implemented in secondary voltage control of distributed cooperative control-based microgrid, and results are validated by comparison with existing distributed secondary control and real-time simulations on real-time simulator OPAL-RT.


title: Controllable Open-ended Question Generation with A New Question Type Ontology

abstract: We investigate the less-explored task of generating open-ended questions that are typically answered by multiple sentences. We first define a new question type ontology which differentiates the nuanced nature of questions better than widely used question words. A new dataset with 4,959 questions is labeled based on the new ontology. We then propose a novel question type-aware question generation framework, augmented by a semantic graph representation, to jointly predict question focuses and produce the question. Based on this framework, we further use both exemplars and automatically generated templates to improve controllability and diversity. Experiments on two newly collected large-scale datasets show that our model improves question quality over competitive comparisons based on automatic metrics. Human judges also rate our model outputs highly in answerability, coverage of scope, and overall quality. Finally, our model variants with templates can produce questions with enhanced controllability and diversity.


title: Root and community inference on the latent growth process of a network

abstract: Many existing statistical models for networks overlook the fact that many real world networks are formed through a growth process. To address this, we introduce the PAPER (Preferential Attachment Plus Erd\H{o}s--R\'{e}nyi) model for random networks, where we let a random network G be the union of a preferential attachment (PA) tree T and additional Erd\H{o}s--R\'{e}nyi (ER) random edges. The PA tree component captures the underlying growth/recruitment process of a network where vertices and edges are added sequentially, while the ER component can be regarded as random noise. Given only a single snapshot of the final network G, we study the problem of constructing confidence sets for the early history, in particular the root node, of the unobserved growth process; the root node can be patient zero in a disease infection network or the source of fake news in a social media network. We propose an inference algorithm based on Gibbs sampling that scales to networks with millions of nodes and provide theoretical analysis showing that the expected size of the confidence set is small so long as the noise level of the ER edges is not too large. We also propose variations of the model in which multiple growth processes occur simultaneously, reflecting the growth of multiple communities, and we use these models to provide a new approach to community detection.


title: The 23-rd and 24-th homotopy groups of the n-th rotation group

abstract: We denote by $\pi_k(R_n)$ the $k$-th homotopy group of the $n$-th rotation group $R_n$ and $\pi_k(R_n:2)$ the 2-primary components of it. We determine the group structures of $\pi_k(R_n:2)$ for $k = 23$ and $24$ by use of the fibration $R_{n+1}\overset{R_n}{\longrightarrow}S^n$. The method is based on Toda's composition methods.


title: KMT-2018-BLG-1743: Planetary Microlensing Event Occurring on Two Source Stars

abstract: We present the analysis of the microlensing event KMT-2018-BLG-1743. The light curve of the event, with a peak magnification $A_{\rm peak}\sim 800$, exhibits two anomaly features, one around the peak and the other on the falling side of the light curve. An interpretation with a binary lens and a single source (2L1S) cannot describe the anomalies. By conducting additional modeling that includes an extra lens (3L1S) or an extra source (2L2S) relative to a 2L1S interpretation, we find that 2L2S interpretations with a planetary lens system and a binary source best explain the observed light curve with $\Delta\chi^2\sim 188$ and $\sim 91$ over the 2L1S and 3L1S solutions, respectively. Assuming that these $\Delta\chi^2$ values are adequate for distinguishing the models, the event is the fourth 2L2S event and the second 2L2S planetary event. The 2L2S interpretations are subject to a degeneracy, resulting in two solutions with $s>1.0$ (wide solution) and $s<1.0$ (close solution). The masses of the lens components and the distance to the lens are $(M_{\rm host}/M_\odot, M_{\rm planet}/M_{\rm J}, D_{\rm L}/{\rm kpc}) \sim (0.19^{+0.27}_{-0.111}, 0.25^{+0.34}_{-0.14}, 6.48^{+0.94}_{-1.03})$ and $\sim (0.42^{+0.34}_{-0.25}, 1.61^{+1.30}_{-0.97}, 6.04^{+0.93}_{-1.27})$ according to the wide and close solutions, respectively. The source is a binary composed of an early G dwarf and a mid M dwarf. The values of the relative lens-source proper motion expected from the two degenerate solutions, $\mu_{\rm wide}\sim 2.3 $mas yr$^{-1}$ and $\mu_{\rm close} \sim 4.1 $mas yr$^{-1}$, are substantially different, and thus the degeneracy can be broken by resolving the lens and source from future high-resolution imaging observations.


title: A Study of the Quality of Wikidata

abstract: Wikidata has been increasingly adopted by many communities for a wide variety of applications, which demand high-quality knowledge to deliver successful results. In this paper, we develop a framework to detect and analyze low-quality statements in Wikidata by shedding light on the current practices exercised by the community. We explore three indicators of data quality in Wikidata, based on: 1) community consensus on the currently recorded knowledge, assuming that statements that have been removed and not added back are implicitly agreed to be of low quality; 2) statements that have been deprecated; and 3) constraint violations in the data. We combine these indicators to detect low-quality statements, revealing challenges with duplicate entities, missing triples, violated type rules, and taxonomic distinctions. Our findings complement ongoing efforts by the Wikidata community to improve data quality, aiming to make it easier for users and editors to find and correct mistakes.


title: Cross-Lingual Transfer Learning for Statistical Type Inference

abstract: Hitherto statistical type inference systems rely thoroughly on supervised learning approaches, which require laborious manual effort to collect and label large amounts of data. Most Turing-complete imperative languages share similar control- and data-flow structures, which make it possible to transfer knowledge learned from one language to another. In this paper, we propose a cross-lingual transfer learning framework, PLATO, for statistical type inference, which allows us to leverage prior knowledge learned from the labeled dataset of one language and transfer it to the others, e.g., Python to JavaScript, Java to JavaScript, etc. PLATO is powered by a novel kernelized attention mechanism to constrain the attention scope of the backbone Transformer model such that the model is forced to base its prediction on commonly shared features among languages. In addition, we propose the syntax enhancement that augments the learning on the feature overlap among language domains. Furthermore, PLATO can also be used to improve the performance of the conventional supervised learning-based type inference by introducing cross-lingual augmentation, which enables the model to learn more general features across multiple languages. We evaluated PLATO under two settings: 1) under the cross-domain scenario that the target language data is not labeled or labeled partially, the results show that PLATO outperforms the state-of-the-art domain transfer techniques by a large margin, e.g., it improves the Python to TypeScript baseline by +5.40%@EM, +5.40%@weighted-F1, and 2) under the conventional monolingual supervised learning based scenario, PLATO improves the Python baseline by +4.40%@EM, +3.20%@EM (parametric).


title: Local available quantum correlations of X states: The symmetric and anti-symmetric cases

abstract: Local available quantum correlations (LAQC), as defined by Mundarain et al., are analyzed for 2-qubit X states with local Bloch vectors of equal magnitude. Symmetric X-states are invariant under the exchange of subsystems, hence having the same {local} Bloch vector. On the other hand, anti-symmetric X states have {local} Bloch vectors with an equal magnitude but opposite direction {(anti-parallel)}. In both cases, we obtain exact analytical expressions for their LAQC quantifier. We present some examples and compare this quantum correlation to concurrence and quantum discord. We have also included Markovian decoherence, with Werner states under amplitude damping decoherence. As is the case for depolarization and phase damping, no sudden death behavior occurs for the LAQC of these states with this quantum channel.


title: A New Algorithm for Equivalence of Cyclic Codes and Its Applications

abstract: Cyclic codes are among the most important families of codes in coding theory for both theoretical and practical reasons. Despite their prominence and intensive research on cyclic codes for over a half century, there are still open problems related to cyclic codes. In this work, we use recent results on the equivalence of cyclic codes to create a more efficient algorithm to partition cyclic codes by equivalence based on cyclotomic cosets. This algorithm is then implemented to carry out computer searches for both cyclic codes and quasi-cyclic (QC) codes with good parameters. We also generalize these results to repeated-root cases. We have found several new linear codes that are cyclic or QC as an application of the new approach, as well as more desirable constructions for linear codes with best known parameters. With the additional new codes obtained through standard constructions, we have found a total of 14 new linear codes.


title: Hierarchical Control of Utility-Scale Solar PV Plants for Mitigation of Generation Variability and Ancillary Service Provision

abstract: Renewable energy technologies including solar and wind inevitably play a leading role in meeting the growing demand for a decarbonized and clean power grid. However, these technologies are highly dependent of meteorological conditions of power plant site and the challenge remains on how to cope with their short-term and momentarily variability. This paper presents a hierarchical control system to provide ancillary services from a solar PV power plant to the grid without the need for additional non-solar resources. With coordinated management of each inverter in the system, the control system commands the power plant to proactively curtail a fraction of its instantaneous maximum power potential, which gives the plant enough headroom to ramp up or down power production from the overall power plant, for a service such as regulation reserve, even under changing cloud cover conditions. A case study from a site in Hawaii with one-second resolution solar irradiance data is used to verify the efficacy of the proposed control system. The algorithm is subsequently compared with an alternative control technology from the literature, the grouping control algorithm; the results show that the proposed hierarchical control system is over 10 times more effective in reducing generator mileage to support power fluctuations from solar PV power plants.


title: The Use of Bandit Algorithms in Intelligent Interactive Recommender Systems

abstract: In today's business marketplace, many high-tech Internet enterprises constantly explore innovative ways to provide optimal online user experiences for gaining competitive advantages. The great needs of developing intelligent interactive recommendation systems are indicated, which could sequentially suggest users the most proper items by accurately predicting their preferences, while receiving the up-to-date feedback to refine the recommendation results, continuously. Multi-armed bandit algorithms, which have been widely applied into various online systems, are quite capable of delivering such efficient recommendation services. However, few existing bandit models are able to adapt to new changes introduced by the modern recommender systems.


title: Computing molecular excited states on a D-Wave quantum annealer

abstract: The possibility of using quantum computers for electronic structure calculations has opened up a promising avenue for computational chemistry. Towards this direction, numerous algorithmic advances have been made in the last five years. The potential of quantum annealers, which are the prototypes of adiabatic quantum computers, is yet to be fully explored. In this work, we demonstrate the use of a D-Wave quantum annealer for the calculation of excited electronic states of molecular systems. These simulations play an important role in a number of areas, such as photovoltaics, semiconductor technology and nanoscience. The excited states are treated using two methods, time-dependent Hartree-Fock (TDHF) and time-dependent density-functional theory (TDDFT), both within a commonly used Tamm-Dancoff approximation (TDA). The resulting TDA eigenvalue equations are solved on a D-Wave quantum annealer using the Quantum Annealer Eigensolver (QAE), developed previously. The method is shown to reproduce a typical basis set convergence on the example H$_2$ molecule and is also applied to several other molecular species. Characteristic properties such as transition dipole moments and oscillator strengths are computed as well. Three potential energy profiles for excited states are computed for NH$_3$ as a function of the molecular geometry. Similar to previous studies, the accuracy of the method is dependent on the accuracy of the intermediate meta-heuristic software called qbsolv.


title: Proton number cumulants and correlation functions in Au-Au collisions at $\sqrt{s_{\rm NN}} = 7.7-200$ GeV from hydrodynamics

abstract: We present a dynamical description of (anti)proton number fluctuations cumulants and correlation functions in central Au-Au collisions at $\sqrt{s_{\rm NN}} = 7.7-200$ GeV by utilizing viscous hydrodynamics simulations. The cumulants of proton and baryon number are calculated in a given momentum acceptance analytically, via an appropriately extended Cooper-Frye procedure describing particlization of an interacting hadron resonance gas. The effects of global baryon number conservation are taken into account using a generalized subensemble acceptance method. The experimental data of the STAR collaboration are consistent at $\sqrt{s_{\rm NN}} \gtrsim 20$ GeV with simultaneous effects of global baryon number conservation and repulsive interactions in baryon sector, the latter being in line with the behavior of baryon number susceptibilities observed in lattice QCD. The data at lower collision energies show possible indications for sizable attractive interactions among baryons. The data also indicate sizable negative two-particle correlations between antiprotons that are not satisfactorily described by baryon conservation and excluded volume effects. We also discuss differences between cumulants and correlation functions (factorial cumulants) of (anti)proton number distribution, proton versus baryon number fluctuations, and effects of hadronic afterburner.


title: MIND: In-Network Memory Management for Disaggregated Data Centers

abstract: Memory-compute disaggregation promises transparent elasticity, high utilization and balanced usage for resources in data centers by physically separating memory and compute into network-attached resource "blades". However, existing designs achieve performance at the cost of resource elasticity, restricting memory sharing to a single compute blade to avoid costly memory coherence traffic over the network. In this work, we show that emerging programmable network switches can enable an efficient shared memory abstraction for disaggregated architectures by placing memory management logic in the network fabric. We find that centralizing memory management in the network permits bandwidth and latency-efficient realization of in-network cache coherence protocols, while programmable switch ASICs support other memory management logic at line-rate. We realize these insights into MIND, an in-network memory management unit for rack-scale memory disaggregation. MIND enables transparent resource elasticity while matching the performance of prior memory disaggregation proposals for real-world workloads.


title: Joint Optimization of Autonomous Electric Vehicle Fleet Operations and Charging Station Siting

abstract: Charging infrastructure is the coupling link between power and transportation networks, thus determining charging station siting is necessary for planning of power and transportation systems. While previous works have either optimized for charging station siting given historic travel behavior, or optimized fleet routing and charging given an assumed placement of the stations, this paper introduces a linear program that optimizes for station siting and macroscopic fleet operations in a joint fashion. Given an electricity retail rate and a set of travel demand requests, the optimization minimizes total cost for an autonomous EV fleet comprising of travel costs, station procurement costs, fleet procurement costs, and electricity costs, including demand charges. Specifically, the optimization returns the number of charging plugs for each charging rate (e.g., Level 2, DC fast charging) at each candidate location, as well as the optimal routing and charging of the fleet. From a case-study of an electric vehicle fleet operating in San Francisco, our results show that, albeit with range limitations, small EVs with low procurement costs and high energy efficiencies are the most cost-effective in terms of total ownership costs. Furthermore, the optimal siting of charging stations is more spatially distributed than the current siting of stations, consisting mainly of high-power Level 2 AC stations (16.8 kW) with a small share of DC fast charging stations and no standard 7.7kW Level 2 stations. Optimal siting reduces the total costs, empty vehicle travel, and peak charging load by up to 10%.


title: Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot?

abstract: There have been long-standing controversies and inconsistencies over the experiment setup and criteria for identifying the "winning ticket" in literature. To reconcile such, we revisit the definition of lottery ticket hypothesis, with comprehensive and more rigorous conditions. Under our new definition, we show concrete evidence to clarify whether the winning ticket exists across the major DNN architectures and/or applications. Through extensive experiments, we perform quantitative analysis on the correlations between winning tickets and various experimental factors, and empirically study the patterns of our observations. We find that the key training hyperparameters, such as learning rate and training epochs, as well as the architecture characteristics such as capacities and residual connections, are all highly correlated with whether and when the winning tickets can be identified. Based on our analysis, we summarize a guideline for parameter settings in regards of specific architecture characteristics, which we hope to catalyze the research progress on the topic of lottery ticket hypothesis. Our codes are publicly available at: https://github.com/boone891214/sanity-check-LTH.


title: A subsolution theorem for the Monge-Amp\`{e}re equation over an almost Hermitian manifold

abstract: Let $\Omega\subseteq M$ be a bounded domain with a smooth boundary $\partial\Omega$, where $(M,J,g)$ is a compact, almost Hermitian manifold. The main result of this paper is to consider the Dirichlet problem for a complex Monge-Amp\`{e}re equation on $\Omega$. Under the existence of a $C^{2}$-smooth strictly $J$-plurisubharmonic ($J$-psh for short) subsolution, we can solve this Dirichlet problem. Our method is based on the properties of subsolutions which have been widely used for fully nonlinear elliptic equations over Hermitian manifolds.


title: The Skipper CCD for low-energy threshold particle experiments above ground

abstract: We present experimental results using a single-electron resolution Skipper-CCD running above ground level to demonstrate the potential of this technology for its use in reactor neutrino observations and other low-energy particle interaction experiments. Operating conditions and event-selection criteria are provided to decouple most of the background rate at low energies. Our final results for events with energies as low as $5$ ionized electron-hole pairs show that the exponentially increasing rate of events seen in other technologies is not present in our data. This demonstrates that the Skipper CCD proves to be among the best options to measure low energy and weakly interacting particles at ground level.


title: Unveiling the Burgers-Riccati physics of fast acoustic streaming

abstract: Inaccurate slow streaming models of acoustically-induced fluid flow remain in use due to the lack of a generalized alternative. The Multiscale Articulated Differentials Method (MADaM; [see co-article]) solves this problem with a complete, scale-sensitive spatiotemporal expansion. Applied to classic axial Eckart streaming, the MADaM produces, in terms of a Burgers equation, a long-sought transient solution able to accommodate frequencies and amplitudes far beyond slow streaming models. Steady streaming is governed by a corresponding Riccati equation that, when solved, produces simple expressions explaining innate features of fast acoustic streaming.


title: A new tableau model for irreducible polynomial representations of the orthogonal group

abstract: We provide a new tableau model from which one can easily deduce the characters of finite-dimensional irreducible polynomial representations of the special orthogonal group $SO_n(\mathbb{C})$. This model originates from the representation theory of the $\imath$quantum group (also known as the quantum symmetric pair coideal subalgebra) of type $\mathrm{A\!I}$, and is equipped with a combinatorial structure, which we call $\mathrm{A\!I}$-crystal structure. This structure enables us to describe combinatorially the tensor product of an $SO_n(\mathbb{C})$-module and a $GL_n(\mathbb{C})$-module, and the branching from $GL_n(\mathbb{C})$ to $SO_n(\mathbb{C})$.


title: p-wave superconductivity and the axi-planar phase of triple-point fermions

abstract: We consider weak-coupling superconductivity in the inversion- and rotation-symmetric system of two pseudospin $s=1$ low-energy fermions of opposite chirality. General contact interactions can lead to Cooper instabilities towards d-wave or towards a novel $2\times 3$ p-wave matrix order parameter. We compute the Ginzburg-Landau free energy for the latter. Remarkably, in this case the Ginzburg-Landau free energy can be minimized exactly, with the resulting ordered state being analogous to the ``axi-planar" p-wave, which exhibits extra degeneracy, and generally breaks time reversal symmetry. Whereas a generic Ginzburg-Landau free energy for our order parameter has only $U(1) \times SO(2) \times SO(3)$ symmetry, at weak coupling we find it displaying the enlarged $U(1)\times SO(3) \times U(1) \times SO(3)$ symmetry, broken down to $SO(2)\times SO(2)$ in the axi-planar ordered phase, and leading therefore to six Goldstone bosons. We show how the lattice, once restored, fixes the allowed values of the magnetization in the superconducting state by locking the spatial directions implicit in the order parameter to its high-symmetry axes.


title: Modeling fast acoustic streaming: steady state and transient flow solutions

abstract: We describe a novel mathematical method to supplant the classic approach and properly treat the spatiotemporal scale disparities present between the acoustics and remaining fluid dynamics. The method is applied in this work to well-known problems of semi-infinite extent defined by the Navier-Stokes equations, and preserves unsteady fluid behavior driven by the acoustic wave. The separation of the governing equations between the fast (acoustic) and slow (hydrodynamic) spatiotemporal scales are shown to naturally arise from the intrinsic properties of the fluid under forcing, not by arbitrary assumption beforehand. Solution of the unsteady streaming field equations provides physical insight into observed temporal evolution of bulk streaming flows that, to date, have not been modeled. A Burgers equation is derived from the new method to represent unsteady flow. By then assuming steady flow, a Riccati equation is found to represent it. Solving these equations produces direct, concise insight into the nonlinearity of the acoustic streaming phenomenon alongside an absolute, universal upper bound of 50\% for the energy efficiency in transducing acoustic energy input to the acoustic streaming energy output. Rigorous validation with respect to experimental and theoretical results from the classic literature is presented to connect this work to past efforts by many authors.


title: Differential Rotation in a 3D Simulation of Oxygen Shell Burning

abstract: We study differential rotation in late-stage shell convection in a 3D hydrodynamic simulation of a rapidly rotating $16M_\odot$ helium star with a particular focus on the convective oxygen shell. We find that the oxygen shell develops a quasi-stationary pattern of differential rotation that is neither described by uniform angular velocity as assumed in current stellar evolution models of supernova progenitors, nor by uniform specific angular momentum. Instead, the oxygen shell develops a positive angular velocity gradient with faster rotation at the equator than at the pole by tens of percent. We show that the angular momentum transport inside the convection zone is not adequately captured by a diffusive mixing-length flux proportional to the angular velocity or angular momentum gradient. Zonal flow averages reveal stable large-scale meridional flow and an entropy deficit near the equator that mirrors the patterns in the angular velocity. The structure of the flow is reminiscent of simulations of stellar surface convection zones and the differential rotation of the Sun, suggesting that similar effects are involved; future simulations will need to address in more detail how the interplay of buoyancy, inertial forces, and turbulent stresses shapes differential rotation during late-stage convection in massive stars. If convective regions develop positive angular velocity gradients, angular momentum could be shuffled out of the core region more efficiently, potentially making the formation of millisecond magnetars more difficult. Our findings have implications for neutron star birth spin periods and supernova explosion scenarios that involve rapid core rotation.


title: On an equivalence of divisors on $\bar{M}_{0,n}$ from Gromov-Witten theory and conformal blocks

abstract: We consider a conjecture that identifies two types of base point free divisors on $\bar{M}_{0,n}$. The first arises from Gromov-Witten theory of a Grassmannian. The second comes from first Chern classes of vector bundles associated to simple Lie algebras in type A. Here we reduce this conjecture on $\bar{M}_{0,n}$ to the same statement for $n=4$. A reinterpretation leads to a proof of the conjecture on $\bar{M}_{0,n}$ for a large class, and we give sufficient conditions for the non-vanishing of these divisors.


title: Elbert: Fast Albert with Confidence-Window Based Early Exit

abstract: Despite the great success in Natural Language Processing (NLP) area, large pre-trained language models like BERT are not well-suited for resource-constrained or real-time applications owing to the large number of parameters and slow inference speed. Recently, compressing and accelerating BERT have become important topics. By incorporating a parameter-sharing strategy, ALBERT greatly reduces the number of parameters while achieving competitive performance. Nevertheless, ALBERT still suffers from a long inference time. In this work, we propose the ELBERT, which significantly improves the average inference speed compared to ALBERT due to the proposed confidence-window based early exit mechanism, without introducing additional parameters or extra training overhead. Experimental results show that ELBERT achieves an adaptive inference speedup varying from 2$\times$ to 10$\times$ with negligible accuracy degradation compared to ALBERT on various datasets. Besides, ELBERT achieves higher accuracy than existing early exit methods used for accelerating BERT under the same computation cost. Furthermore, to understand the principle of the early exit mechanism, we also visualize the decision-making process of it in ELBERT.


title: Reinforcement Learning for Abstractive Question Summarization with Question-aware Semantic Rewards

abstract: The growth of online consumer health questions has led to the necessity for reliable and accurate question answering systems. A recent study showed that manual summarization of consumer health questions brings significant improvement in retrieving relevant answers. However, the automatic summarization of long questions is a challenging task due to the lack of training data and the complexity of the related subtasks, such as the question focus and type recognition. In this paper, we introduce a reinforcement learning-based framework for abstractive question summarization. We propose two novel rewards obtained from the downstream tasks of (i) question-type identification and (ii) question-focus recognition to regularize the question generation model. These rewards ensure the generation of semantically valid questions and encourage the inclusion of key medical entities/foci in the question summary. We evaluated our proposed method on two benchmark datasets and achieved higher performance over state-of-the-art models. The manual evaluation of the summaries reveals that the generated questions are more diverse and have fewer factual inconsistencies than the baseline summaries


title: Nonlocal Trace Spaces and Extension Results for Nonlocal Calculus

abstract: For a given Lipschitz domain $\Omega$, it is a classical result that the trace space of $W^{1,p}(\Omega)$ is $W^{1-1/p,p}(\partial\Omega)$, namely any $W^{1,p}(\Omega)$ function has a well-defined $W^{1-1/p,p}(\partial\Omega)$ trace on its codimension-1 boundary $\partial\Omega$ and any $W^{1-1/p,p}(\partial\Omega)$ function on $\partial\Omega$ can be extended to a $W^{1,p}(\Omega)$ function. Recently, Dyda and Kassmann (2019) characterize the trace space for nonlocal Dirichlet problems involving integrodifferential operators with infinite interaction ranges, where the boundary datum is provided on the whole complement of the given domain $\mathbb{R}^d\backslash\Omega$. In this work, we study function spaces for nonlocal Dirichlet problems with a finite range of nonlocal interactions, which naturally serves a bridging role between the classical local PDE problem and the nonlocal problem with infinite interaction ranges. For these nonlocal Dirichlet problems, the boundary conditions are normally imposed on a region with finite thickness volume which lies outside of the domain. We introduce a function space on the volumetric boundary region that serves as a trace space for these nonlocal problems and study the related extension results. Moreover, we discuss the consistency of the new nonlocal trace space with the classical $W^{1-1/p,p}(\partial\Omega)$ space as the size of nonlocal interaction tends to zero. In making this connection, we conduct an investigation on the relations between nonlocal interactions on a larger domain and the induced interactions on its subdomain. The various forms of trace, embedding and extension theorems may then be viewed as consequences in different scaling limits.


title: Attention-based multi-channel speaker verification with ad-hoc microphone arrays

abstract: Recently, ad-hoc microphone array has been widely studied. Unlike traditional microphone array settings, the spatial arrangement and number of microphones of ad-hoc microphone arrays are not known in advance, which hinders the adaptation of traditional speaker verification technologies to ad-hoc microphone arrays. To overcome this weakness, in this paper, we propose attention-based multi-channel speaker verification with ad-hoc microphone arrays. Specifically, we add an inter-channel processing layer and a global fusion layer after the pooling layer of a single-channel speaker verification system. The inter-channel processing layer applies a so-called residual self-attention along the channel dimension for allocating weights to different microphones. The global fusion layer integrates all channels in a way that is independent to the number of the input channels. We further replace the softmax operator in the residual self-attention with sparsemax, which forces the channel weights of very noisy channels to zero. Experimental results with ad-hoc microphone arrays of over 30 channels demonstrate the effectiveness of the proposed methods. For example, the multi-channel speaker verification with sparsemax achieves an equal error rate (EER) of over 20% lower than oracle one-best system on semi-real data sets, and over 30% lower on simulation data sets, in test scenarios with both matched and mismatched channel numbers.


title: Distributed Nonparametric Function Estimation: Optimal Rate of Convergence and Cost of Adaptation

abstract: Distributed minimax estimation and distributed adaptive estimation under communication constraints for Gaussian sequence model and white noise model are studied. The minimax rate of convergence for distributed estimation over a given Besov class, which serves as a benchmark for the cost of adaptation, is established. We then quantify the exact communication cost for adaptation and construct an optimally adaptive procedure for distributed estimation over a range of Besov classes. The results demonstrate significant differences between nonparametric function estimation in the distributed setting and the conventional centralized setting. For global estimation, adaptation in general cannot be achieved for free in the distributed setting. The new technical tools to obtain the exact characterization for the cost of adaptation can be of independent interest.


title: First observation of MeV gamma-ray universe with bijective imaging spectroscopy using the Electron-Tracking Compton Telescope aboard SMILE-2+

abstract: MeV gamma-rays provide a unique window for the direct measurement of line emissions from radioisotopes, but observations have made little significant progress after COMPTEL/{\it CGRO}. To observe celestial objects in this band, we are developing an electron-tracking Compton camera (ETCC), which realizes both bijective imaging spectroscopy and efficient background reduction gleaned from the recoil electron track information. The energy spectrum of the observation target can then be obtained by a simple ON-OFF method using a correctly defined point spread function on the celestial sphere. The performance of celestial object observations was validated on the second balloon SMILE-2+ installed with an ETCC having a gaseous electron tracker with a volume of 30$\times$30$\times$30 cm$^3$. Gamma-rays from the Crab nebula were detected with a significance of 4.0$\sigma$ in the energy range 0.15--2.1 MeV with a live time of 5.1 h, as expected before launching. Additionally, the light curve clarified an enhancement of gamma-ray events generated in the Galactic center region, indicating that a significant proportion of the final remaining events are cosmic gamma rays. Independently, the observed intensity and time variation were consistent with the pre-launch estimates except in the Galactic center region. The estimates were based on the total background of extragalactic diffuse, atmospheric, and instrumental gamma-rays after accounting for the variations in the atmospheric depth and rigidity during the level flight. The Crab results and light curve strongly support our understanding of both the detection sensitivity and the background in real observations. This work promises significant advances in MeV gamma-ray astronomy.


title: Revisiting Knowledge Distillation: An Inheritance and Exploration Framework

abstract: Knowledge Distillation (KD) is a popular technique to transfer knowledge from a teacher model or ensemble to a student model. Its success is generally attributed to the privileged information on similarities/consistency between the class distributions or intermediate feature representations of the teacher model and the student model. However, directly pushing the student model to mimic the probabilities/features of the teacher model to a large extent limits the student model in learning undiscovered knowledge/features. In this paper, we propose a novel inheritance and exploration knowledge distillation framework (IE-KD), in which a student model is split into two parts - inheritance and exploration. The inheritance part is learned with a similarity loss to transfer the existing learned knowledge from the teacher model to the student model, while the exploration part is encouraged to learn representations different from the inherited ones with a dis-similarity loss. Our IE-KD framework is generic and can be easily combined with existing distillation or mutual learning methods for training deep neural networks. Extensive experiments demonstrate that these two parts can jointly push the student model to learn more diversified and effective representations, and our IE-KD can be a general technique to improve the student network to achieve SOTA performance. Furthermore, by applying our IE-KD to the training of two networks, the performance of both can be improved w.r.t. deep mutual learning. The code and models of IE-KD will be make publicly available at https://github.com/yellowtownhz/IE-KD.


title: Thermodynamics of Dyonic NUT Charged Black Holes with Entropy as Noether Charge

abstract: We investigate the thermodynamic behaviour of Lorentzian Dyonic Taub-NUT Black Hole spacetimes. We consider two possibilities in their description: one in which their entropy is interpreted to be one quarter of the horizon area (the horizon entropy), and another in which the Misner string also contributes to the entropy (the Noether charge entropy). We find that there can be as many as three extremal black holes (or as few as zero) depending on the choice of parameters, and that the dependence of the free energy on temperature -- and the resultant phase behaviour -- depends very much on which of these situations holds. Some of the phase behaviour we observe holds regardless of which interpretation of the entropy holds. However another class of phase transition structures occurs only if the Noether charge interpretation of the entropy is adopted.


title: Stochastic Performance Modeling for Practical Byzantine Fault Tolerance Consensus in Blockchain

abstract: The practical Byzantine fault tolerant (PBFT) consensus mechanism is one of the most basic consensus algorithms (or protocols) in blockchain technologies, thus its performance evaluation is an interesting and challenging topic due to a higher complexity of its consensus work in the peer-to-peer network. This paper describes a simple stochastic performance model of the PBFT consensus mechanism, which is refined as not only a queueing system with complicated service times but also a level-independent quasi-birth-and-death (QBD) process. From the level-independent QBD process, we apply the matrix-geometric solution to obtain a necessary and sufficient condition under which the PBFT consensus system is stable, and to be able to numerically compute the stationary probability vector of the QBD process. Thus we provide four useful performance measures of the PBFT consensus mechanism, and can numerically calculate the four performance measures. Finally, we use some numerical examples to verify the validity of our theoretical results, and show how the four performance measures are influenced by some key parameters of the PBFT consensus. By means of the theory of multi-dimensional Markov processes, we are optimistic that the methodology and results given in this paper are applicable in a wide range research of PBFT consensus mechanism and even other types of consensus mechanisms.


title: Bilinear Scoring Function Search for Knowledge Graph Learning

abstract: Learning embeddings for entities and relations in knowledge graph (KG) have benefited many downstream tasks. In recent years, scoring functions, the crux of KG learning, have been human-designed to measure the plausibility of triples and capture different kinds of relations in KGs. However, as relations exhibit intricate patterns that are hard to infer before training, none of them consistently perform the best on benchmark tasks. In this paper, inspired by the recent success of automated machine learning (AutoML), we search bilinear scoring functions for different KG tasks through the AutoML techniques. However, it is non-trivial to explore domain-specific information here. We first set up a search space for AutoBLM by analyzing existing scoring functions. Then, we propose a progressive algorithm (AutoBLM) and an evolutionary algorithm (AutoBLM+), which are further accelerated by filter and predictor to deal with the domain-specific properties for KG learning. Finally, we perform extensive experiments on benchmarks in KG completion, multi-hop query, and entity classification tasks. Empirical results show that the searched scoring functions are KG dependent, new to the literature, and outperform the existing scoring functions. AutoBLM+ is better than AutoBLM as the evolutionary algorithm can flexibly explore better structures in the same budget.


title: A Blockchain-based Carbon Credit Ecosystem

abstract: Climate change and global warming are the significant challenges of the new century. A viable solution to mitigate greenhouse gas emissions is via a globally incentivized market mechanism proposed in the Kyoto protocol. In this view, the carbon dioxide (or other greenhouse gases) emission is considered a commodity, forming a carbon trading system. There have been attempts in developing this idea in the past decade with limited success. The main challenges of current systems are fragmented implementations, lack of transparency leading to over-crediting and double-spending, and substantial transaction costs that transfer wealth to brokers and agents. We aim to create a Carbon Credit Ecosystem using smart contracts that operate in conjunction with blockchain technology in order to bring more transparency, accessibility, liquidity, and standardization to carbon markets. This ecosystem includes a tokenization mechanism to securely digitize carbon credits with clear minting and burning protocols, a transparent mechanism for distribution of tokens, a free automated market maker for trading the carbon tokens, and mechanisms to engage all stakeholders, including the energy industry, project verifiers, liquidity providers, NGOs, concerned citizens, and governments. This approach could be used in a variety of other credit/trading systems.


title: Word-Free Spoken Language Understanding for Mandarin-Chinese

abstract: Spoken dialogue systems such as Siri and Alexa provide great convenience to people's everyday life. However, current spoken language understanding (SLU) pipelines largely depend on automatic speech recognition (ASR) modules, which require a large amount of language-specific training data. In this paper, we propose a Transformer-based SLU system that works directly on phones. This acoustic-based SLU system consists of only two blocks and does not require the presence of ASR module. The first block is a universal phone recognition system, and the second block is a Transformer-based language model for phones. We verify the effectiveness of the system on an intent classification dataset in Mandarin Chinese.


title: Context-aware Execution Migration Tool for Data Science Jupyter Notebooks on Hybrid Clouds

abstract: Interactive computing notebooks, such as Jupyter notebooks, have become a popular tool for developing and improving data-driven models. Such notebooks tend to be executed either in the user's own machine or in a cloud environment, having drawbacks and benefits in both approaches. This paper presents a solution developed as a Jupyter extension that automatically selects which cells, as well as in which scenarios, such cells should be migrated to a more suitable platform for execution. We describe how we reduce the execution state of the notebook to decrease migration time and we explore the knowledge of user interactivity patterns with the notebook to determine which blocks of cells should be migrated. Using notebooks from Earth science (remote sensing), image recognition, and hand written digit identification (machine learning), our experiments show notebook state reductions of up to 55x and migration decisions leading to performance gains of up to 3.25x when the user interactivity with the notebook is taken into consideration.


title: Effect of orbital trapping by bar resonances in the local U-V velocity field

abstract: The effects in the local U-V velocity field due to orbital trapping by bar resonances have been studied computing fifteen resonant families in a non-axisymmetric Galactic potential, considering the bar's angular velocity between 35 and 57.5 ${\rm\,km\,s^{-1}{kpc}^{-1}}$. Only cases in the low, 37.5, 40 ${\rm\,km\,s^{-1}{kpc}^{-1}}$, and high, 55, 57.5 ${\rm\,km\,s^{-1}{kpc}^{-1}}$, velocity ranges give trapping structures that have some similarity with observed features in the velocity distribution. The resulting structures in the local U-V plane form resonant bands appearing at various levels in velocity V. Cases with angular velocity 40 and 55 ${\rm\,km\,s^{-1}{kpc}^{-1}}$ show the greatest similarity with observed branches. Our best approximation to the local velocity field by orbital trapping is obtained with a bar angular velocity of 40 ${\rm\,km\,s^{-1}{kpc}^{-1}}$ and a bar angle of 40${^\circ}$. With this solution, three main observed features can be approximated: i) the Hercules branch at V=$-50$ ${\rm\,km\,s^{-1}}$ produced by the resonance 8/1 outside corotation, and the close features produced by resonances 5/1 and 6/1, ii) the newly detected low-density arch at V $\simeq$ 40 ${\rm\,km\,s^{-1}}$ produced approximately by the resonance 4/3, iii) the inclined structure below the Hercules branch, also observed in the $\textit{Gaia}$ DR2 data, produced by tube orbits around Lagrange point $L_5$ at corotation. Some predicted contributions due to orbital trapping in regions of the U-V plane corresponding to the Galactic halo are given, which could help to further restrict the value of the angular velocity of the Galactic bar. No support by orbital trapping is found for the Arcturus stream at V $\approx$ $-100$ ${\rm\,km\,s^{-1}}$.


title: Capturing Event Argument Interaction via A Bi-Directional Entity-Level Recurrent Decoder

abstract: Capturing interactions among event arguments is an essential step towards robust event argument extraction (EAE). However, existing efforts in this direction suffer from two limitations: 1) The argument role type information of contextual entities is mainly utilized as training signals, ignoring the potential merits of directly adopting it as semantically rich input features; 2) The argument-level sequential semantics, which implies the overall distribution pattern of argument roles over an event mention, is not well characterized. To tackle the above two bottlenecks, we formalize EAE as a Seq2Seq-like learning problem for the first time, where a sentence with a specific event trigger is mapped to a sequence of event argument roles. A neural architecture with a novel Bi-directional Entity-level Recurrent Decoder (BERD) is proposed to generate argument roles by incorporating contextual entities' argument role predictions, like a word-by-word text generation process, thereby distinguishing implicit argument distribution patterns within an event more accurately.


title: Regularization by transport noise for 3D MHD equations

abstract: We consider the problem of regularization by noise for the three dimensional magnetohydrodynamical (3D MHD) equations. It is shown that, in a suitable scaling limit, multiplicative noise of transport type gives rise to bounds on the vorticity fields of the fluid velocity and magnetic fields. As a result, if the noise intensity is big enough, then the stochastic 3D MHD equations admit a pathwise unique global solution for large initial data, with high probability.


title: Unsupervised Model Drift Estimation with Batch Normalization Statistics for Dataset Shift Detection and Model Selection

abstract: While many real-world data streams imply that they change frequently in a nonstationary way, most of deep learning methods optimize neural networks on training data, and this leads to severe performance degradation when dataset shift happens. However, it is less possible to annotate or inspect newly streamed data by humans, and thus it is desired to measure model drift at inference time in an unsupervised manner. In this paper, we propose a novel method of model drift estimation by exploiting statistics of batch normalization layer on unlabeled test data. To remedy possible sampling error of streamed input data, we adopt low-rank approximation to each representational layer. We show the effectiveness of our method not only on dataset shift detection but also on model selection when there are multiple candidate models among model zoo or training trajectories in an unsupervised way. We further demonstrate the consistency of our method by comparing model drift scores between different network architectures.


title: Implications of Flat Optically Thick Microwave Spectra in Solar Flares for Source Size and Morphology

abstract: The study aims to examine the spectral dynamics of the low-frequency, optically thick gyrosynchrotron microwave emission in solar flares to determine the characteristics of the emitting source. We present the high-resolution spectra of a set of microwave bursts observed by the Expanded Owens Valley Solar Array (EOVSA) during its commissioning phase in the $2.5-18$ GHz frequency range with $1$ second time resolution. Out of the 12 events analyzed in this study, nine bursts exhibit a direct decrease with time in the optically thick spectral index $\alpha_l$, an indicator of source morphology. Particularly, five bursts display "flat" spectrum ($\alpha_l\leq1.0$) compared to that expected for a homogeneous/uniform source ($\alpha_l\approx2.9$). These flat spectra at the low-frequencies (<$10$ GHz) can be defined as the emission from a spatially inhomogeneous source with a large area and/or with multiple emission components. In a subset of six events with partial cross-correlation data, both the events with flat spectra show a source size of $\sim120$ arcsec at $2.6-3$ GHz. Modeling based on inhomogeneity supports the conclusion that multiple discrete sources can only reproduce a flat spectrum. We report that these flat spectra appear predominantly in the decay phase and typically grow flatter over the duration in most of the bursts, which indicates the increasing inhomogeneity and complexity of the emitting volume as the flare progresses. This large volume of flare emission filled with the trapped energetic particles is often invisible in other wavelengths, like hard X-rays, presumably due to the collisionless conditions in these regions of low ambient density and magnetic field strength.


title: Solid Source Metal-Organic Molecular Beam Epitaxy of Epitaxial RuO2

abstract: A seemingly simple oxide with a rutile structure, RuO2 has been shown to possess several intriguing properties ranging from strain-stabilized superconductivity to a strong catalytic activity. Much interest has arisen surrounding the controlled synthesis of RuO2 films but, unfortunately, utilizing atomically-controlled deposition techniques like molecular beam epitaxy (MBE) has been difficult due to the ultra-low vapor pressure and low oxidation potential of Ru. Here, we demonstrate the growth of epitaxial, single-crystalline RuO2 films on different substrate orientations using the novel solid-source metal-organic (MO) MBE. This approach circumvents these issues by supplying Ru using a pre-oxidized solid metal-organic precursor containing Ru. High-quality epitaxial RuO2 films with bulk-like room-temperature resistivity of 55 micro-ohm-cm were obtained at a substrate temperature as low as 300 C. By combining X-ray diffraction, transmission electron microscopy, and electrical measurements, we discuss the effect of substrate temperature, orientation, film thickness, and strain on the structure and electrical properties of these films. Our results illustrating the use of novel solid-source MOMBE approach paves the way to the atomic-layer controlled synthesis of complex oxides of stubborn metals, which are not only difficult to evaporate but also hard to oxidize.


title: Adaptive Control for Robotic Manipulation of Deformable Linear Objects with Offline and Online Learning of Unknown Models

abstract: The deformable linear objects (DLOs) are common in both industrial and domestic applications, such as wires, cables, ropes. Because of its highly deformable nature, it is difficult for the robot to reproduce human's dexterous skills on DLOs. In this paper, the unknown deformation model is estimated in both the offline and online manners. The offline learning aims to provide a good approximation prior to the manipulation task, while the online learning aims to compensate the errors due to insufficient training (e.g. limited datasets) in the offline phase. The offline module works by constructing a series of supervised neural networks (NNs), then the online module receives the learning results directly and further updates them with the technique of adaptive NNs. A new adaptive controller is also proposed to allow the robot to perform manipulation tasks concurrently in the online phase. The stability of the closed-loop system and the convergence of task errors are rigorously proved with Lyapunov method. Simulation studies are presented to illustrate the performance of the proposed method.


title: Non-parametric Semi-Supervised Learning in Many-body Hilbert Space with Rescaled Logarithmic Fidelity

abstract: In quantum and quantum-inspired machine learning, the very first step is to embed the data in quantum space known as Hilbert space. Developing quantum kernel function (QKF), which defines the distances among the samples in the Hilbert space, belongs to the fundamental topics for machine learning. In this work, we propose the rescaled logarithmic fidelity (RLF) and non-parametric semi-supervised learning in the quantum space, which we name as RLF-NSSL. The rescaling takes advantage of the non-linearity of the kernel to tune the mutual distances of samples in the Hilbert space, and meanwhile avoids the exponentially-small fidelities between quantum many-qubit states. Being non-parametric excludes the possible effects from the variational parameters, and evidently demonstrates the advantages from the space itself. We compare RLF-NSSL with several well-known non-parametric algorithms including naive Bayes classifiers, k-nearest neighbors, and spectral clustering. Our method exhibits better accuracy particularly for the unsupervised case with no labeled samples and the few-shot cases with small numbers of labeled samples. With the visualizations by t-stochastic neighbor embedding, our results imply that the machine learning in the Hilbert space complies with the principles of maximal coding rate reduction, where the low-dimensional data exhibit within-class compressibility, between-class discrimination, and overall diversity. Our proposals can be applied to other quantum and quantum-inspired machine learning, including the methods using the parametric models such as tensor networks, quantum circuits, and quantum neural networks.


title: Bayesian Phase Estimation via Active Learning

abstract: Bayesian estimation approaches, which are capable of combining the information of experimental data from different likelihood functions to achieve high precisions, have been widely used in phase estimation via introducing a controllable auxiliary phase. Here, we present a non-adaptive Bayesian phase estimation (BPE) algorithms with an ingenious update rule of the auxiliary phase designed via active learning. Unlike adaptive BPE algorithms, the auxiliary phase in our algorithm is determined by a pre-established update rule with simple statistical analysis of a small batch of data, instead of complex calculations in every update trails. As the number of measurements for a same amount of Bayesian updates is significantly reduced via active learning, our algorithm can work as efficient as adaptive ones and shares the advantages (such as wide dynamic range and perfect noise robustness) of non-adaptive ones. Our algorithm is of promising applications in various practical quantum sensors such as atomic clocks and quantum magnetometers.


title: Few-Shot Learning with a Strong Teacher

abstract: Few-shot learning (FSL) aims to generate a classifier using limited labeled examples. Many existing works take the meta-learning approach, constructing a few-shot learner that can learn from few-shot examples to generate a classifier. Typically, the few-shot learner is constructed or meta-trained by sampling multiple few-shot tasks in turn and optimizing the few-shot learner's performance in generating classifiers for those tasks. The performance is measured by how well the resulting classifiers classify the test (i.e., query) examples of those tasks. In this paper, we point out two potential weaknesses of this approach. First, the sampled query examples may not provide sufficient supervision for meta-training the few-shot learner. Second, the effectiveness of meta-learning diminishes sharply with the increasing number of shots. To resolve these issues, we propose a novel meta-training objective for the few-shot learner, which is to encourage the few-shot learner to generate classifiers that perform like strong classifiers. Concretely, we associate each sampled few-shot task with a strong classifier, which is trained with ample labeled examples. The strong classifiers can be seen as the target classifiers that we hope the few-shot learner to generate given few-shot examples, and we use the strong classifiers to supervise the few-shot learner. We present an efficient way to construct the strong classifier, making our proposed objective an easily plug-and-play term to existing meta-learning based FSL methods. We validate our approach, LastShot, in combinations with many representative meta-learning methods. On several benchmark datasets, our approach leads to a notable improvement across a variety of tasks. More importantly, with our approach, meta-learning based FSL methods can outperform non-meta-learning based methods at different numbers of shots.


title: Bertrand's analysis of baccarat

abstract: Joseph Bertrand [1822--1900], who is often credited with a model of duopoly that has a unique Nash equilibrium, made another significant contribution to game theory. Specifically, his 1888 analysis of baccarat was the starting point for Borel's investigation of strategic games in the 1920s. In this paper we show, with near certainty, that Bertrand's results on baccarat were borrowed, without attribution, from an 1881 paper of Albert Badoureau [1853--1923]. In addition, we discuss Borel's criticisms of Bertrand's analysis, one of which helps to explain why Badoureau's contribution was overlooked until now.


title: Worldline master formulas for the dressed electron propagator, part 2: On-shell amplitudes

abstract: In the first part of this series, we employed the second-order formalism and the ``symbol'' map to construct a particle path-integral representation of the electron propagator in a background electromagnetic field, suitable for open fermion-line calculations. Its main advantages are the avoidance of long products of Dirac matrices, and its ability to unify whole sets of Feynman diagrams related by permutation of photon legs along the fermion lines. We obtained a Bern-Kosower type master formula for the fermion propagator, dressed with $N$ photons, in terms of the ``$N$-photon kernel,'' where this kernel appears also in ``subleading'' terms involving only $N$-$1$ of the $N$ photons. In this sequel, we focus on the application of the formalism to the calculation of on-shell amplitudes and cross sections. Universal formulas are obtained for the fully polarised matrix elements of the fermion propagator dressed with an arbitrary number of photons, as well as for the corresponding spin-averaged cross sections. A major simplification of the on-shell case is that the subleading terms drop out, but we also pinpoint other, less obvious simplifications. We use integration by parts to achieve manifest transversality of these amplitudes at the integrand level and exploit this property using the spinor helicity technique. We give a simple proof of the vanishing of the matrix element for ``all $+$'' photon helicities in the massless case, and find a novel relation between the scalar and spinor spin-averaged cross sections in the massive case. Testing the formalism on the standard linear Compton scattering process, we find that it reproduces the known results with remarkable efficiency. Further applications and generalisations are pointed out.


title: Social Coordination and Altruism in Autonomous Driving

abstract: Despite the advances in the autonomous driving domain, autonomous vehicles (AVs) are still inefficient and limited in terms of cooperating with each other or coordinating with vehicles operated by humans. A group of autonomous and human-driven vehicles (HVs) which work together to optimize an altruistic social utility -- as opposed to the egoistic individual utility -- can co-exist seamlessly and assure safety and efficiency on the road. Achieving this mission without explicit coordination among agents is challenging, mainly due to the difficulty of predicting the behavior of humans with heterogeneous preferences in mixed-autonomy environments. Formally, we model an AV's maneuver planning in mixed-autonomy traffic as a partially-observable stochastic game and attempt to derive optimal policies that lead to socially-desirable outcomes using a multi-agent reinforcement learning framework. We introduce a quantitative representation of the AVs' social preferences and design a distributed reward structure that induces altruism into their decision making process. Our altruistic AVs are able to form alliances, guide the traffic, and affect the behavior of the HVs to handle competitive driving scenarios. As a case study, we compare egoistic AVs to our altruistic autonomous agents in a highway merging setting and demonstrate the emerging behaviors that lead to a noticeable improvement in the number of successful merges as well as the overall traffic flow and safety.


title: Controllable inter-skyrmion attractions and resulting skyrmion-lattice structures in two-dimensional chiral magnets with in-plane anisotropy

abstract: We study inter-skyrmion interactions and stable spin configurations in a 2D chiral magnet with in-plane anisotropies of a tilted magnetic field and the magneto-crystalline anisotropy on a (011) thin film. We find that in both cases a small deformation of a skyrmion shape makes the inter-skyrmion interaction anisotropic, and that the skyrmions are weakly bounded along a certain direction due to an emergent attractive interaction. Furthermore, when the magneto-crystalline anisotropy is comparable to the Zeeman energy, skyrmions embedded in a uniform magnetization are tightly bound by creating a magnetic domain between them. The formation of the magnetic domain, and thus the strength of the inter-skyrmion interaction, can be controlled by the direction of an external magnetic field. The anisotropic interaction also affects the skyrmion alignment in the skyrmion crystal (SkX) phase. By employing the Monte Carlo simulation and the micromagnetic simulation, we obtain an elongated triangular lattice structure in the SkX phase. In particular, in the presence of a strong magneto-crystalline anisotropy, magnetic domains appear in the background of the lattice structure, and bimerons aligned on the domain walls form an elongated triangular lattice. We also find a parameter region that the SkX phase is stabilized due to the inter-skyrmion attraction.


title: New examples of Weierstrass semigroups associated with a double covering of a curve on a Hirzebruch surface of degree one

abstract: Let $\varphi:\Sigma_1\longrightarrow \mathbb{P}^2$ be a blow up at a point on $\mathbb{P}^2$. Let $C$ be the proper transform of a smooth plane curve of degree $d\geq 4$ by $\varphi$, and let $P$ be a point on $C$. Let $\pi:\tilde{C}\longrightarrow C$ be a double covering branched along the reduced divisor on $C$ obtained as the intersection of $C$ and a reduced divisor in $|-2K_{\Sigma_1}|$ containing $P$. In this paper, we investigate the Weierstrass semigroup $H(\tilde{P})$ at the ramification point $\tilde{P}$ of $\pi$ over $P$, in the case where the intersection multiplicity at $\varphi(P)$ of $\varphi(C)$ and the tangent line at $\varphi(P)$ of $\varphi(C)$ is $d-1$.


title: Travel Cadence and Epidemic Spread

abstract: In this paper, we study how interactions between populations impact epidemic spread. We extend the classical SEIR model to include both integration-based disease transmission simulation and population flow. Our model differs from existing ones by having a more detailed representation of travel patterns, without losing tractability. This allows us to study the epidemic consequence of inter-regional travel with high fidelity. In particular, we define \emph{travel cadence} as a two-dimensional measure of inter-regional travel, and show that both dimensions modulate epidemic spread. This technical insight leads to policy recommendations, pointing to a family of simple policy trajectories that can effectively curb epidemic spread while maintaining a basic level of mobility.


title: Markov Decision Process modeled with Bandits for Sequential Decision Making in Linear-flow

abstract: For marketing, we sometimes need to recommend content for multiple pages in sequence. Different from general sequential decision making process, the use cases have a simpler flow where customers per seeing recommended content on each page can only return feedback as moving forward in the process or dropping from it until a termination state. We refer to this type of problems as sequential decision making in linear--flow. We propose to formulate the problem as an MDP with Bandits where Bandits are employed to model the transition probability matrix. At recommendation time, we use Thompson sampling (TS) to sample the transition probabilities and allocate the best series of actions with analytical solution through exact dynamic programming. The way that we formulate the problem allows us to leverage TS's efficiency in balancing exploration and exploitation and Bandit's convenience in modeling actions' incompatibility. In the simulation study, we observe the proposed MDP with Bandits algorithm outperforms Q-learning with $\epsilon$-greedy and decreasing $\epsilon$, independent Bandits, and interaction Bandits. We also find the proposed algorithm's performance is the most robust to changes in the across-page interdependence strength.


title: Ergodic Average Of Typical Orbits And Typical Functions

abstract: In this article we mainly aim to know what kind of asymptotic behavior of typical orbits can display. For example, we show in any transitive system, the emprical measures of a typical orbit can cover all emprical measures of dense orbits and can intersect some physical-like measures. In particular, if the union set of emprical measures of all dense orbits is not singleton, then the typical orbit will display historic behavior simultaneously for typical continuous functions and the limit set of ergodic average along every continuous function equals to a closed interval composed by the union of limit sets of ergodic average on all dense orbits. Moreover, if the union set of emprical measures of all dense orbits contains all ergodic measures, the above interval equals to the rotation set. These results are not only suitable for systems with specification-like properties or minimal systems, but also suitable for many other systems including all general (not assumed uniformly hyperbolic) nontrivial homoclinic classes and Bowen eyes. Moreover, we introduce a new property called m-g-product property weaker than classical specification property and minimal property and nontrivial examples are constructed.


title: Multi-modal Graph Learning for Disease Prediction

abstract: Benefiting from the powerful expressive capability of graphs, graph-based approaches have achieved impressive performance in various biomedical applications. Most existing methods tend to define the adjacency matrix among samples manually based on meta-features, and then obtain the node embeddings for downstream tasks by Graph Representation Learning (GRL). However, it is not easy for these approaches to generalize to unseen samples. Meanwhile, the complex correlation between modalities is also ignored. As a result, these factors inevitably yield the inadequacy of providing valid information about the patient's condition for a reliable diagnosis. In this paper, we propose an end-to-end Multimodal Graph Learning framework (MMGL) for disease prediction. To effectively exploit the rich information across multi-modality associated with diseases, amodal-attentional multi-modal fusion is proposed to integrate the features of each modality by leveraging the correlation and complementarity between the modalities. Furthermore, instead of defining the adjacency matrix manually as existing methods, the latent graph structure can be captured through a novel way of adaptive graph learning. It could be jointly optimized with the prediction model, thus revealing the intrinsic connections among samples. Unlike the previous transductive methods, our model is also applicable to the scenario of inductive learning for those unseen data. An extensive group of experiments on two disease prediction problems is then carefully designed and presented, demonstrating that MMGL obtains more favorable performances. In addition, we also visualize and analyze the learned graph structure to provide more reliable decision support for doctors in real medical applications and inspiration for disease research.


title: A two-track tour of Cauchy's Cours

abstract: Cauchy published his Cours d'Analyse 200 years ago. We analyze Cauchy's take on the concepts of rigor, continuity, and limit, and explore a pair of approaches in the literature to the meaning of his infinitesimal analysis and his sum theorem on the convergence of series of continuous functions.


title: Stochastic thermodynamics of inertial-like Stuart-Landau dimer

abstract: Stuart-Landau limit-cycle oscillators are a paradigm in the study of coherent and incoherent limit cycles. In this work, we generalize the standard Stuart-Landau dimer model to include effects due to an inertia-like term and noise and study its dynamics and stochastic thermodynamics. In the absence of noise (zero-temperature limit), the dynamics show the emergence of a new bistable phase where coherent and incoherent limit cycles coexist. At finite temperatures, we develop a stochastic thermodynamic framework based on the dynamics of a charged particle in a magnetic field to identify physically meaningful heat and work. The stochastic system no longer exhibits the bistable phase but the thermodynamic observables, such as work, exhibit bistability in the temporally metastable regime. We demonstrate that the inertial-like Stuart-Landau dimer operates like a machine, reliably outputting the most work when the oscillators coherently synchronize and unreliable with minimum work output when the oscillators are incoherent. Overall, our results show the importance of coherent synchronization within the working substance in the operation of a thermal machine.


title: Binary Neural Network in Robotic Manipulation: Flexible Object Manipulation for Humanoid Robot Using Partially Binarized Auto-Encoder on FPGA

abstract: A neural network based flexible object manipulation system for a humanoid robot on FPGA is proposed. Although the manipulations of flexible objects using robots attract ever increasing attention since these tasks are the basic and essential activities in our daily life, it has been put into practice only recently with the help of deep neural networks. However such systems have relied on GPU accelerators, which cannot be implemented into the space limited robotic body. Although field programmable gate arrays (FPGAs) are known to be energy efficient and suitable for embedded systems, the model size should be drastically reduced since FPGAs have limited on-chip memory. To this end, we propose ``partially'' binarized deep convolutional auto-encoder technique, where only an encoder part is binarized to compress model size without degrading the inference accuracy. The model implemented on Xilinx ZCU102 achieves 41.1 frames per second with a power consumption of 3.1W, {\awano{which corresponds to 10x and 3.7x improvements from the systems implemented on Core i7 6700K and RTX 2080 Ti, respectively.


title: Secure Transmission with Different Security Requirements Based on Covert Communication and Information-Theoretic Security in Presence of Friendly Jammer

abstract: In this paper, we investigate joint information-theoretic security and covert communication on a network in the presence of a single transmitter (Alice), a friendly jammer, a single untrusted user, two legitimate users, and a single warden of the channel (Willie). In the considered network, one of the authorized users, Bob, needs a secure and covert communication, and therefore his message must be sent securely, and at the same time, the existence of his communication with the transmitter should not be detected by the channel's warden, Willie, Meanwhile, another authorized user, Carol, needs covert communication. The purpose of secure communication is to prevent the message being decoded by the untrusted user who is present on the network, which leads us to use one of the physical layer security methods, named the secure transmission of information theory. In some cases, in addition to protecting the content of the message, it is important for the user that the existence of the transmission not being detected by an adversary, which leads us to covert communication. In the proposed network model, it is assumed that for covert communication requirements, Alice will not send any messages to legitimate users in one time slot and in another time slot will send to them both (Bob and Carol). One of the main challenges in covert communication is low transmission rate, because we have to reduce the transmission power such that the main message get hide in background noise.


title: A Few Interactions Improve Distributed Nonparametric Estimation, Optimally

abstract: Consider the problem of nonparametric estimation of an unknown $\beta$-H\"older smooth density $p_{XY}$ at a given point, where $X$ and $Y$ are both $d$ dimensional. An infinite sequence of i.i.d.\ samples $(X_i,Y_i)$ are generated according to this distribution, and two terminals observe $(X_i)$ and $(Y_i)$, respectively. They are allowed to exchange $k$ bits either in oneway or interactively in order for Bob to estimate the unknown density. We show that the minimax mean square risk is order $\left(\frac{k}{\log k} \right)^{-\frac{2\beta}{d+2\beta}}$ for one-way protocols and $k^{-\frac{2\beta}{d+2\beta}}$ for interactive protocols. The logarithmic improvement is nonexistent in the parametric counterparts, and therefore can be regarded as a consequence of nonparametric nature of the problem. Moreover, a few rounds of interactions achieve the interactive minimax rate: the number of rounds can grow as slowly as the super-logarithm (i.e., inverse tetration) of $k$. The proof of the upper bound is based on a novel multi-round scheme for estimating the joint distribution of a pair of biased Bernoulli variables, and the lower bound is built on a sharp estimate of a symmetric strong data processing constant for biased Bernoulli variables.


title: Identifying the Prevalence of Gender Biases among the Computing Organizations

abstract: We have designed an online survey to understand the status quo of four dimensions of gender biases among the contemporary computing organizations. Our preliminary results found almost one-third of the respondents have reported first-hand experiences of encountering gender biases at their jobs.


title: The strong equitable vertex 1-arboricity of complete bipartite graphs and balanced complete k-partite graphs

abstract: An \emph{equitable $(q, r)$-tree-coloring} of a graph $G$ is a $q$-coloring of $G$ such that the subgraph induced by each color class is a forest of maximum degree at most $r$ and the sizes of any two color classes differ by at most $1.$ Let the \emph{strong equitable vertex $r$-arboricity} of a graph $G,$ denoted by $va^\equiv_r (G)$, be the minimum $p$ such that $G$ has an equitable $(q, r)$-tree-coloring for every $q\geq p.$ The values of $va^\equiv_1 (K_{n,n})$ were investigated by Tao and Lin and Wu, Zhang, and Li where exact values of $va^\equiv_1 (K_{n,n})$ were found in some special cases. In this paper, we extend their results by giving the exact values of $va^\equiv_1 (K_{n,n})$ for all cases. In the process, we introduce a new function related to an equitable coloring and obtain a more general result by determining the exact value of each $va^\equiv_1 (K_{m,n})$ and $va^\equiv_1 (G)$ where $G$ is a balanced complete $k$-partite graph $K_{n,\ldots,n}.$


title: Proof of Reference(PoR): A unified informetrics based consensus mechanism

abstract: Bibliometrics is useful to analyze the research impact for measuring the research quality. Different bibliographic databases like Scopus, Web of Science, Google Scholar etc. are accessed for evaluating the trend of publications and citations from time to time. Some of these databases are free and some are subscription based. Its always debatable that which bibliographic database is better and in what terms. To provide an optimal solution to availability of multiple bibliographic databases, we have implemented a single authentic database named as ``conflate'' which can be used for fetching publication and citation trend of an author. To further strengthen the generated database and to provide the transparent system to the stakeholders, a consensus mechanism ``proof of reference (PoR)'' is proposed. Due to three consent based checks implemented in PoR, we feel that it could be considered as a authentic and honest citation data source for the calculation of unified informetrics for an author.


title: How many samples are needed to reliably approximate the best linear estimator for a linear inverse problem?

abstract: The linear minimum mean squared error (LMMSE) estimator is the best linear estimator for a Bayesian linear inverse problem with respect to the mean squared error. It arises as the solution operator to a Tikhonov-type regularized inverse problem with a particular quadratic discrepancy term and a particular quadratic regularization operator. To be able to evaluate the LMMSE estimator, one must know the forward operator and the first two statistical moments of both the prior and the noise. If such knowledge is not available, one may approximate the LMMSE estimator based on given samples. In this work, it is investigated, in a finite-dimensional setting, how many samples are needed to reliably approximate the LMMSE estimator, in the sense that, with high probability, the mean squared error of the approximation is smaller than a given multiple of the mean squared error of the LMMSE estimator.


title: Almost-Orthogonal Bases for Inner Product Polynomials

abstract: In this paper, we consider low-degree polynomials of inner products between a collection of random vectors. We give an almost orthogonal basis for this vector space of polynomials when the random vectors are Gaussian, spherical, or Boolean. In all three cases, our basis admits an interesting combinatorial description based on the topology of the underlying graph of inner products. We also analyze the expected value of the product of two polynomials in our basis. In all three cases, we show that this expected value can be expressed in terms of collections of matchings on the underlying graph of inner products. In the Gaussian and Boolean cases, we show that this expected value is always non-negative. In the spherical case, we show that this expected value can be negative but we conjecture that if the underlying graph of inner products is planar then this expected value will always be non-negative.


title: Nonlinear stability of planar steady Euler flows associated with semistable solutions of elliptic problems

abstract: This paper is devoted to the study of nonlinear stability of steady incompressible Euler flows in two dimensions. We prove that a steady Euler flow is nonlinearly stable in $L^p$ norm of the vorticity if its stream function is a semistable solution of some semilinear elliptic problem with strictly increasing nonlinearity. The idea of the proof is to show that such a flow has strict local maximum energy among flows whose vorticities are rearrangements of a given function, with the help of an improvement version of Wolansky and Ghil's stability theorem. The result can be regarded as an extension of Arnol'd's second stability theorem.


title: Comparing Example-Based Collaborative Reflection to Problem Solving Practice for Learning during Team-Based Software Engineering Projects

abstract: Contributing to the literature on aptitude-treatment interactions between worked examples and problem-solving, this paper addresses differential learning from the two approaches when students are positioned as domain experts learning new concepts. Our evaluation is situated in a team project that is part of an advanced software engineering course. In this course, students who possess foundational domain knowledge but are learning new concepts engage alternatively in programming followed by worked example-based reflection. They are either allowed to finish programming or are curtailed after a pre-specified time to participate in a longer worked example-based reflection. We find significant pre- to post-test learning gains in both conditions. Then, we not only find significantly more learning when students participated in longer worked example-based reflections but also a significant performance improvement on a problem-solving transfer task. These findings suggest that domain experts learning new concepts benefit more from worked example-based reflections than from problem-solving.