title: Benchmark Dataset and Effective Inter-Frame Alignment for Real-World Video Super-Resolution

abstract: Video super-resolution (VSR) aiming to reconstruct a high-resolution (HR) video from its low-resolution (LR) counterpart has made tremendous progress in recent years. However, it remains challenging to deploy existing VSR methods to real-world data with complex degradations. On the one hand, there are few well-aligned real-world VSR datasets, especially with large super-resolution scale factors, which limits the development of real-world VSR tasks. On the other hand, alignment algorithms in existing VSR methods perform poorly for real-world videos, leading to unsatisfactory results. As an attempt to address the aforementioned issues, we build a real-world 4 VSR dataset, namely MVSR4$\times$, where low- and high-resolution videos are captured with different focal length lenses of a smartphone, respectively. Moreover, we propose an effective alignment method for real-world VSR, namely EAVSR. EAVSR takes the proposed multi-layer adaptive spatial transform network (MultiAdaSTN) to refine the offsets provided by the pre-trained optical flow estimation network. Experimental results on RealVSR and MVSR4$\times$ datasets show the effectiveness and practicality of our method, and we achieve state-of-the-art performance in real-world VSR task. The dataset and code will be publicly available.


title: Space-time virtual elements for the heat equation

abstract: We propose and analyze a space-time virtual element method for the discretization of the heat equation in a space-time cylinder, based on a standard Petrov-Galerkin formulation. Local discrete functions are solutions to a heat equation problem with polynomial data. Global virtual element spaces are nonconforming in space, so that the analysis and the design of the method are independent of the spatial dimension. The information between time slabs is transmitted by means of upwind terms involving polynomial projections of the discrete functions. We prove well posedness and optimal error estimates for the scheme, and validate them with several numerical tests.


title: DeFiNES: Enabling Fast Exploration of the Depth-first Scheduling Space for DNN Accelerators through Analytical Modeling

abstract: DNN workloads can be scheduled onto DNN accelerators in many different ways: from layer-by-layer scheduling to cross-layer depth-first scheduling (a.k.a. layer fusion, or cascaded execution). This results in a very broad scheduling space, with each schedule leading to varying hardware (HW) costs in terms of energy and latency. To rapidly explore this vast space for a wide variety of hardware architectures, analytical cost models are crucial to estimate scheduling effects on the HW level. However, state-of-the-art cost models are lacking support for exploring the complete depth-first scheduling space, for instance focusing only on activations while ignoring weights, or modeling only DRAM accesses while overlooking on-chip data movements. These limitations prevent researchers from systematically and accurately understanding the depth-first scheduling space. After formalizing this design space, this work proposes a unified modeling framework, DeFiNES, for layer-by-layer and depth-first scheduling to fill in the gaps. DeFiNES enables analytically estimating the hardware cost for possible schedules in terms of both energy and latency, while considering data access at every memory level. This is done for each schedule and HW architecture under study by optimally choosing the active part of the memory hierarchy per unique combination of operand, layer, and feature map tile. The hardware costs are estimated, taking into account both data computation and data copy phases. The analytical cost model is validated against measured data from a taped-out depth-first DNN accelerator, DepFiN, showing good modeling accuracy at the end-to-end neural network level. A comparison with generalized state-of-the-art demonstrates up to 10X better solutions found with DeFiNES.


title: Numerical simulation of the response of single gap timing RPCs with the space charge effects and Garfield++

abstract: In this article, we report the simulated response of timing RPCs of different gas gaps. A 3D Montecarlo code was developed and integrated with Garfield++ to simulate the avalanche processes with space charge effects which allow actual charge and timing spectrums. The results of this study are presented with examples of timing RPCs of gas gaps 0.02 cm and 0.03 cm.


title: Dissipative stabilization of entangled qubit pairs in quantum arrays with a single localized dissipative channel

abstract: We study the dissipative stabilization of entangled states in arrays of quantum systems. Specifically, we are interested in the states of qubits (spin-1/2) which may or may not interact with one or more cavities (bosonic modes). In all cases only one element, either a cavity or a qubit, is lossy and irreversibly coupled to a reservoir. When the lossy element is a cavity, we consider a squeezed reservoir and only interactions which conserve the number of cavity excitations. Instead, when the lossy element is a qubit, pure decay and a properly selected structure of XY-interactions are taken into account. We show that in all cases, in the steady state, many pairs of distant, non-directly interacting qubits, which cover the whole array, can get entangled in a stationary way, by means of the interplay of dissipation and local interactions.


title: A systematic literature review on insider threats

abstract: Insider threats is the most concerned cybersecurity problem which is poorly addressed by widely used security solutions. Despite the fact that there have been several scientific publications in this area, but from our innovative study classification and structural taxonomy proposals, we argue to provide the more information about insider threats and defense measures used to counter them. While adopting the current grounded theory method for a thorough literature evaluation, our categorization's goal is to organize knowledge in insider threat research. Along with an analysis of major recent studies on detecting insider threats, the major goal of the study is to develop a classification of current types of insiders, levels of access, motivations behind it, insider profiling, security properties, and methods they use to attack. This includes use of machine learning algorithm, behavior analysis, methods of detection and evaluation. Moreover, actual incidents related to insider attacks have also been analyzed.


title: A unified approach to reverse engineering and data selection for unique network identification

abstract: Due to cost concerns, it is optimal to gain insight into the connectivity of biological and other networks using as few experiments as possible. Data selection for unique network connectivity identification has been an open problem since the introduction of algebraic methods for reverse engineering for almost two decades. In this manuscript we determine what data sets uniquely identify the unsigned wiring diagram corresponding to a system that is discrete in time and space. Furthermore, we answer the question of uniqueness for signed wiring diagrams for Boolean networks. Computationally, unsigned and signed wiring diagrams have been studied separately, and in this manuscript we also show that there exists an ideal capable of encoding both unsigned and signed information. This provides a unified approach to studying reverse engineering that also gives significant computational benefits.


title: On different approaches to freeze-in and freeze-out leptogenesis with quasi-degenerate neutrinos

abstract: We compare two approaches for determining the generation of lepton asymmetry during production and decay of quasi-degenerate neutrinos, namely the density matrix formalism and a recent proposal which does not involve any counting of neutrino number densities and is based on plugging the resummed propagator in a quantum field theory model for neutrino oscillations. We show numerically and analytically that they are almost equivalent except in the limit of very large mass splittings. The comparison, performed in a simple scalar toy model, helps to understand several issues that have been discussed in the literature.


title: Microwave response of type-II superconductors at weak pinning

abstract: Theory of linear microwave response of thin films of type-II superconductors in the mixed state is developed taking into account random spatial fluctuations of the parameters of the system, such as the order parameter, diffusion coefficient, or film thickness. In the regime of collective pinning the microwave response of the system exhibits strong frequency dispersion, arising from nonequilibrium vortex core quasiparticles. The corresponding contribution to the ac conductivity is controlled by the inelastic relaxation time, and may exceed the usual Bardeen-Stephen conductivity. It is caused by the Debye-type inelastic relaxation. Debye mechanism of microwave losses may be responsible for strong effects of electromagnetic noise upon dc conductivity in the mixed state at low temperatures.


title: Unified model for the LISA measurements and instrument simulations

abstract: LISA is a space-based mHz gravitational-wave observatory, with a planned launch in 2034. It is expected to be the first detector of its kind, and will present unique challenges in instrumentation and data analysis. An accurate preflight simulation of LISA data is a vital part of the development of both the instrument and the analysis methods. The simulation must include a detailed model of the full measurement and analysis chain, capturing the main features that affect the instrument performance and processing algorithms. Here, we propose a new model that includes, for the first time, proper relativistic treatment of reference frames with realistic orbits; a model for onboard clocks and clock synchronization measurements; proper modeling of total laser frequencies, including laser locking, frequency planning and Doppler shifts; better treatment of onboard processing and updated noise models. We then introduce two implementations of this model, LISANode and LISA Instrument. We demonstrate that TDI processing successfully recovers gravitational-wave signals from the significantly more realistic and complex simulated data. LISANode and LISA Instrument are already widely used by the LISA community and, for example, currently provide the mock data for the LISA Data Challenges.


title: Ultralow-noise terahertz detection by p-n junctions in gapped bilayer graphene

abstract: Graphene shows a strong promise for detection of terahertz (THz) radiation due to its high carrier mobility, compatibility with on-chip waveguides and transistors, and small heat capacitance. At the same time, weak reaction of graphene's physical properties on the detected radiation can be traced down to the absence of band gap. Here, we study the effect of electrically-induced band gap on THz detection in graphene bilayer with split-gate p-n junction. We show that gap induction leads to simultaneous increase in current and voltage responsivities. At operating temperatures of ~25 K, the responsivity at 20 meV band gap is from 3 to 20 times larger than that in the gapless state. The maximum voltage responsivity of our devices at 0.13 THz illumination exceeds 50 kV/W, while the noise equivalent power falls down to 36 fW/Hz^0.5. These values set new records for semiconductor-based cryogenic terahertz detectors, and pave the way for efficient and fast terahertz detection.


title: How many cards should you lay out in a game of EvenQuads?: A detailed study of 2-caps in AG(n,2)

abstract: A 2-cap in the affine geometry $AG(n, q)$ is a subset of 4 points in general position. In this paper we classify all 2-caps in $AG(n, 2)$, up to affine equivalence, for $n \leq 6$. We also provide structural results for general $n$. Since the EvenQuads card deck is a model for $AG(6, 2)$, as a consequence we determine the probability that an arbitrary $k$-card layout contains a quad.


title: Phenomenological modeling of diverse and heterogeneous synaptic dynamics at natural density

abstract: This chapter sheds light on the synaptic organization of the brain from the perspective of computational neuroscience. It provides an introductory overview on how to account for empirical data in mathematical models, implement such models in software, and perform simulations reflecting experiments. This path is demonstrated with respect to four key aspects of synaptic signaling: the connectivity of brain networks, synaptic transmission, synaptic plasticity, and the heterogeneity across synapses. Each step and aspect of the modeling and simulation workflow comes with its own challenges and pitfalls, which are highlighted and addressed.


title: High-dimensional Berry-Esseen Bound for $m$-Dependent Random Samples

abstract: In this work, we provide a $(n/m)^{-1/2}$-rate finite sample Berry-Esseen bound for $m$-dependent high-dimensional random vectors over the class of hyper-rectangles. This bound imposes minimal assumptions on the random vectors such as nondegenerate covariances and finite third moments. The proof uses inductive relationships between anti-concentration inequalities and Berry--Esseen bounds, which are inspired by the telescoping method of Chen and Shao (2004) and the recursion method of Kuchibhotla and Rinaldo (2020). Performing a dual induction based on the relationships, we obtain tight Berry-Esseen bounds for dependent samples.


title: Punctuation Restoration for Singaporean Spoken Languages: English, Malay, and Mandarin

abstract: This paper presents the work of restoring punctuation for ASR transcripts generated by multilingual ASR systems. The focus languages are English, Mandarin, and Malay which are three of the most popular languages in Singapore. To the best of our knowledge, this is the first system that can tackle punctuation restoration for these three languages simultaneously. Traditional approaches usually treat the task as a sequential labeling task, however, this work adopts a slot-filling approach that predicts the presence and type of punctuation marks at each word boundary. The approach is similar to the Masked-Language Model approach employed during the pre-training stages of BERT, but instead of predicting the masked word, our model predicts masked punctuation. Additionally, we find that using Jieba1 instead of only using the built-in SentencePiece tokenizer of XLM-R can significantly improve the performance of punctuating Mandarin transcripts. Experimental results on English and Mandarin IWSLT2022 datasets and Malay News show that the proposed approach achieved state-of-the-art results for Mandarin with 73.8% F1-score while maintaining a reasonable F1-score for English and Malay, i.e. 74.7% and 78% respectively. Our source code that allows reproducing the results and building a simple web-based application for demonstration purposes is available on Github.


title: On Blockchain We Cooperate: An Evolutionary Game Perspective

abstract: Cooperation is fundamental for human prosperity. Blockchain, as a trust machine, is a cooperative institution in cyberspace that supports cooperation through distributed trust with consensus protocols. While studies in computer science focus on fault tolerance problems with consensus algorithms, economic research utilizes incentive designs to analyze agent behaviors. To achieve cooperation on blockchains, emerging interdisciplinary research introduces rationality and game-theoretical solution concepts to study the equilibrium outcomes of various consensus protocols. However, existing studies do not consider the possibility for agents to learn from historical observations. Therefore, we abstract a general consensus protocol as a dynamic game environment, apply a solution concept of bounded rationality to model agent behavior, and resolve the initial conditions for three different stable equilibria. In our game, agents imitatively learn the global history in an evolutionary process toward equilibria, for which we evaluate the outcomes from both computing and economic perspectives in terms of safety, liveness, validity, and social welfare. Our research contributes to the literature across disciplines, including distributed consensus in computer science, game theory in economics on blockchain consensus, evolutionary game theory at the intersection of biology and economics, bounded rationality at the interplay between psychology and economics, and cooperative AI with joint insights into computing and social science. Finally, we discuss that future protocol design can better achieve the most desired outcomes of our honest stable equilibria by increasing the reward-punishment ratio and lowering both the cost-punishment ratio and the pivotality rate.


title: Efficient and Generic Algorithms for Quantitative Attack Tree Analysis

abstract: Numerous analysis methods for quantitative attack tree analysis have been proposed. These algorithms compute relevant security metrics, i.e. performance indicators that quantify how good the security of a system is; typical metrics being the most likely attack, the cheapest, or the most damaging one. However, existing methods are only geared towards specific metrics or do not work on general attack trees. This paper classifies attack trees in two dimensions: proper trees vs. directed acyclic graphs (i.e. with shared subtrees); and static vs. dynamic gates. For three out of these four classes, we propose novel algorithms that work over a generic attribute domain, encompassing a large number of concrete security metrics defined on the attack tree semantics; dynamic attack trees with directed acyclic graph structure are left as an open problem. We also analyse the computational complexity of our methods.


title: Wake-Based Locomotion Gait Design for Aerobat

abstract: Flying animals, such as bats, fly through their fluidic environment as they create air jets and form wake structures downstream of their flight path. Bats, in particular, dynamically morph their highly flexible and dexterous armwing to manipulate their fluidic environment which is key to their agility and flight efficiency. This paper presents the theoretical and numerical analysis of the wake-structure-based gait design inspired by bat flight for flapping robots using the notion of reduced-order models and unsteady aerodynamic model incorporating Wagner function. The objective of this paper is to introduce the notion of gait design for flapping robots by systematically searching the design space in the context of optimization. The solution found using our gait design framework was used to design and test a flapping robot.


title: Synthetic Wave-Geometric Impulse Responses for Improved Speech Dereverberation

abstract: We present a novel approach to improve the performance of learning-based speech dereverberation using accurate synthetic datasets. Our approach is designed to recover the reverb-free signal from a reverberant speech signal. We show that accurately simulating the low-frequency components of Room Impulse Responses (RIRs) is important to achieving good dereverberation. We use the GWA dataset that consists of synthetic RIRs generated in a hybrid fashion: an accurate wave-based solver is used to simulate the lower frequencies and geometric ray tracing methods simulate the higher frequencies. We demonstrate that speech dereverberation models trained on hybrid synthetic RIRs outperform models trained on RIRs generated by prior geometric ray tracing methods on four real-world RIR datasets.


title: Aerobat, A Bioinspired Drone to Test High-DOF Actuation and Embodied Aerial Locomotion

abstract: This work presents an actuation framework for a bioinspired flapping drone called Aerobat. This drone, capable of producing dynamically versatile wing conformations, possesses 14 body joints and is tail-less. Therefore, in our robot, unlike mainstream flapping wing designs that are open-loop stable and have no pronounced morphing characteristics, the actuation, and closed-loop feedback design can pose significant challenges. We propose a framework based on integrating mechanical intelligence and control. In this design framework, small adjustments led by several tiny low-power actuators called primers can yield significant flight control roles owing to the robot's computational structures. Since they are incredibly lightweight, the system can host the primers in large numbers. In this work, we aim to show the feasibility of joint's motion regulation in Aerobat's untethered flights.


title: Stembridge codes and Chow rings

abstract: It is well known that the Eulerian polynomial is the Hilbert series of the cohomology of the permutohedral variety. We answer a question of Stembridge on finding a geometric explanation of the \emph{permutation representation} this cohomology carries. Our explanation involves an $\mathfrak{S}_n$-equivariant bijection between a basis for the Chow ring of the Boolean matroid and codes introduced by Stembridge. There are analogous results for the stellohedral variety. We provide a geometric explanation of the permutation representation that its cohomology carries. This involves the augmented Chow ring of a matroid introduced by Braden, Huh, Matherne, Proudfoot and Wang. Along the way, we also obtain some new results on augmented Chow rings.


title: Nuclear spin relaxation in cold atom-molecule collisions

abstract: We explore the quantum dynamics of nuclear spin relaxation in cold collisions of $^1\Sigma^+$ molecules with structureless atoms in an external magnetic field. To this end, we develop a rigorous coupled-channel methodology, which accounts for rotational and nuclear spin degrees of freedom of $^1\Sigma^+$ molecules, their interaction with an external magnetic field, as well as for anisotropic atom-molecule interactions. We apply the methodology to study collisional relaxation of the nuclear spin sublevels of $^{13}$CO molecules immersed in a cold buffer gas of $^4$He atoms. We find that nuclear spin relaxation in the ground rotational manifold of CO occurs extremely slowly due to the absence of direct couplings between the nuclear spin sublevels. The rates of collisional transitions between the $N=1$ nuclear spin states of CO are generally much higher due to the direct nuclear spin-rotation coupling between the states. These transitions obey selection rules, which depend on the values of space-fixed projections of rotational and nuclear spin angular momenta for the initial and final molecular states. For some initial states, we also observe a strong magnetic field dependence, which can be understood using the first Born approximation. We use our calculated nuclear spin relaxation rates to investigate the thermalization of a single nuclear spin state of CO$(N=0)$ immersed in a cold buffer gas of He. The calculated nuclear spin relaxation times ($T_1\simeq 0.5$ s at $T=1$ K) display a steep temperature dependence decreasing rapidly at elevated temperatures due to the increased population of rotationally excited states, which undergo nuclear spin relaxation at a much faster rate. Thus, long relaxation times of $N=0$ nuclear spin states in cold collisions with buffer gas atoms can only be maintained at sufficiently low temperatures ($kT\ll 2B_e$), where $B_e$ is the rotational constant.


title: Gradient-tracking Based Differentially Private Distributed Optimization with Enhanced Optimization Accuracy

abstract: Privacy protection has become an increasingly pressing requirement in distributed optimization. However, equipping distributed optimization with differential privacy, the state-of-the-art privacy protection mechanism, will unavoidably compromise optimization accuracy. In this paper, we propose an algorithm to achieve rigorous $\epsilon$-differential privacy in gradient-tracking based distributed optimization with enhanced optimization accuracy. More specifically, to suppress the influence of differential-privacy noise, we propose a new robust gradient-tracking based distributed optimization algorithm that allows both stepsize and the variance of injected noise to vary with time. Then, we establish a new analyzing approach that can characterize the convergence of the gradient-tracking based algorithm under both constant and time-varying stespsizes. To our knowledge, this is the first analyzing framework that can treat gradient-tracking based distributed optimization under both constant and time-varying stepsizes in a unified manner. More importantly, the new analyzing approach gives a much less conservative analytical bound on the stepsize compared with existing proof techniques for gradient-tracking based distributed optimization. We also theoretically characterize the influence of differential-privacy design on the accuracy of distributed optimization, which reveals that inter-agent interaction has a significant impact on the final optimization accuracy. Numerical simulation results confirm the theoretical predictions.


title: Graphs with large girth and chromatic number are hard for Nullstellensatz

abstract: We study the computational efficiency of approaches, based on Hilbert's Nullstellensatz, which use systems of linear equations for detecting non-colorability of graphs having large girth and chromatic number. We show that for every non-$k$-colorable graph with $n$ vertices and girth $g>4k$, the algorithm is required to solve systems of size at least $n^{\Omega(g)}$ in order to detect its non-$k$-colorability.


title: Specialization of Difference Equations and High Frobenius Powers

abstract: We study valued fields equipped with an automorphism $\sigma$ which is locally infinitely contracting in the sense that $\alpha\ll\sigma\alpha$ for all $0<\alpha\in\Gamma$. We show that various notions of valuation theory, such as Henselian and strictly Henselian hulls, admit meaningful transformal analogues. We prove canonical amalgamation results, and exhibit the way that transformal wild ramification is controlled by torsors over generalized vector groups. Model theoretically, we determine the model companion: it is decidable, admits a simple axiomatization, and enjoys elimination of quantifiers up to algebraically bounded quantifiers. The model companion is shown to agree with the limit theory of the Frobenius action on an algebraically closed and nontrivially valued field. This opens the way to a motivic intersection theory for difference varieties that was previously available only in characteristic zero. As a first consequence, the class of algebraically closed valued fields equipped with a distinguished Frobenius $x\mapsto x^{q}$ is decidable, uniformly in $q$.


title: Weakest link pruning of a dendrogram

abstract: Hierarchical clustering is a popular method for identifying distinct groups in a dataset. The most commonly used method for pruning a dendrogram is via a single horizontal cut. In this paper, we propose a new technique "weakest link optimal pruning". We prove its superiority over horizontal pruning and provide some examples illustrating how the two methods can behave quite differently.


title: Existence of asymmetric vortex patch for the generalized SQG equations

abstract: This paper aims to study the existence of asymmetric solutions for the two-dimensional generalized surface quasi-geostrophic (gSQG) equations of simply connected patches for $\alpha\in[1,2)$ in the whole plane, where $\alpha=1$ corresponds to the surface quasi-geostrophic equations (SQG). More precisely, we construct non-trivial simply connected co-rotating and traveling patches with unequal vorticity magnitudes. The proof is carried out by means of a combination of a desingularization argument with the implicit function theorem on the linearization of contour dynamics equation. Our results extend recent ones in the range $\alpha\in[0,1)$ by Hassainia-Hmidi (DCDS-A, 2021) and Hassainia-Wheeler (SIAM J. Math. Anal., 2022) to more singular velocities, filling an open gap in the range of $\alpha$.


title: Time Series Analysis in American Stock Market Recovering in Post COVID-19 Pandemic Period

abstract: Every financial crisis has caused a dual shock to the global economy. The shortage of market liquidity, such as default in debt and bonds, has led to the spread of bankruptcies, such as Lehman Brothers in 2008. Using the data for the ETFs of the S&P 500, Nasdaq 100, and Dow Jones Industrial Average collected from Yahoo Finance, this study implemented Deep Learning, Neuro Network, and Time-series to analyze the trend of the American Stock Market in the post-COVID-19 period. LSTM model in Neuro Network to predict the future trend, which suggests the US stock market keeps falling for the post-COVID-19 period. This study reveals a reasonable allocation method of Long Short-Term Memory for which there is strong evidence.


title: Source-free Depth for Object Pop-out

abstract: Depth cues are known to be useful for visual perception. However, direct measurement of depth is often impracticable. Fortunately, though, modern learning-based methods offer promising depth maps by inference in the wild. In this work, we adapt such depth inference models for object segmentation using the objects' "pop-out" prior in 3D. The "pop-out" is a simple composition prior that assumes objects reside on the background surface. Such compositional prior allows us to reason about objects in the 3D space. More specifically, we adapt the inferred depth maps such that objects can be localized using only 3D information. Such separation, however, requires knowledge about contact surface which we learn using the weak supervision of the segmentation mask. Our intermediate representation of contact surface, and thereby reasoning about objects purely in 3D, allows us to better transfer the depth knowledge into semantics. The proposed adaptation method uses only the depth model without needing the source data used for training, making the learning process efficient and practical. Our experiments on eight datasets of two challenging tasks, namely camouflaged object detection and salient object detection, consistently demonstrate the benefit of our method in terms of both performance and generalizability.


title: Unbounded loops in quantum programs: categories and weak while loops

abstract: Control flow of quantum programs is often divided into two different classes: classical and quantum. Quantum programs with classical control flow have their conditional branching determined by the classical outcome of measurements, and these collapse quantum data. Conversely, quantum control flow is coherent, i.e. it does not perturb quantum data; quantum walk-based algorithms are practical examples where coherent quantum feedback plays a major role. This dissertation has two main contributions: (i) a categorical study of coherent quantum iteration and (ii) the introduction of weak while loops. (i) The objective is to endow categories of quantum processes with a traced monoidal structure capable of modelling iterative quantum loops. To this end, the trace of a morphism is calculated via the execution formula, which adds up the contribution of all possible paths of the control flow. Haghverdi's unique decomposition categories are generalised to admit additive inverses and equipped with convergence criteria using basic topology. In this setting, it is possible to prove the validity of the execution formula as a categorical trace on certain categories of quantum processes. (ii) A weak while loop is a classical control flow primitive that offers a trade-off between the collapse caused on each iteration and the amount of information gained. The trade-off may be adjusted by tuning a parameter and, in certain situations, it is possible to set its value so that we may control the algorithm without sacrificing its quantum speed-up. As an example, it is shown that Grover's search problem can be implemented using a weak while loop, maintaining the same time complexity as the standard Grover's algorithm (as previously shown by Mizel).


title: Multipartite entanglement in the 1-D spin-$\frac{1}{2}$ Heisenberg Antiferromagnet

abstract: Multipartite entanglement refers to the simultaneous entanglement between multiple subsystems of a many-body quantum system. While multipartite entanglement can be difficult to quantify analytically, it is known that it can be witnessed through the Quantum Fisher information (QFI), a quantity that can also be related to dynamical Kubo response functions. In this work, we first show that the finite temperature QFI can generally be expressed in terms of a static structure factor of the system, plus a correction that vanishes as $T\rightarrow 0$. We argue that this implies that the static structure factor witnesses multipartite entanglement near quantum critical points at temperatures below a characteristic energy scale that is determined by universal properties, up to a non-universal amplitude. Therefore, in systems with a known static structure factor, we can deduce finite temperature scaling of multipartite entanglement and low temperature entanglement depth without knowledge of the full dynamical response function of the system. This is particularly useful to study 1D quantum critical systems in which sub-power-law divergences can dominate entanglement growth, where the conventional scaling theory of the QFI breaks down. The 1D spin-$\frac{1}{2}$ antiferromagnetic Heisenberg model is an important example of such a system, and we show that multipartite entanglement in the Heisenberg chain diverges non-trivially as $\sim \log(1/T)^{3/2}$. We verify these predictions with calculations of the QFI using conformal field theory and matrix product state simulations. Finally we discuss the implications of our results for experiments to probe entanglement in quantum materials, comparing to neutron scattering data in KCuF$_3$, a material well-described by the Heisenberg chain.


title: Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access

abstract: To alleviate the problem of structured databases' limited coverage, recent task-oriented dialogue systems incorporate external unstructured knowledge to guide the generation of system responses. However, these usually use word or sentence level similarities to detect the relevant knowledge context, which only partially capture the topical level relevance. In this paper, we examine how to better integrate topical information in knowledge grounded task-oriented dialogue and propose ``Topic-Aware Response Generation'' (TARG), an end-to-end response generation model. TARG incorporates multiple topic-aware attention mechanisms to derive the importance weighting scheme over dialogue utterances and external knowledge sources towards a better understanding of the dialogue history. Experimental results indicate that TARG achieves state-of-the-art performance in knowledge selection and response generation, outperforming previous state-of-the-art by 3.2, 3.6, and 4.2 points in EM, F1 and BLEU-4 respectively on Doc2Dial, and performing comparably with previous work on DSTC9; both being knowledge-grounded task-oriented dialogue datasets.


title: Mediumband Wireless Communication

abstract: The fundamental phenomenon widely known as multipath is unavoidable in wireless communication, and affects almost every element of modern wireless communication systems. The impact of multipath on the received signal depends on whether the delay spread (i.e., spread of time delays associated with different multipath components) is large or small relative to the signalling period of the wireless communication system. In narrowband systems, the delay spread is about one tenth (or less) of the signalling period. The delay spread and the signalling period of broadband systems are in the same order of magnitude. In between these two extremes, there appears to exist an important, yet overlooked, class of systems whose delay spread is neither small nor large enough for them to fall into these two basic classes. In this paper, the effect of multipath on this class of systems denoted henceforth as mediumband is studied, and its channel is characterized in compact form in order to enable future research into this class of wireless communication systems.


title: On a reverse Kohler-Jobin inequality

abstract: We consider the shape optimization problems for the quantities $\lambda(\Omega)T^q(\Omega)$, where $\Omega$ varies among open sets of $\mathbb{R}^d$ with a prescribed Lebesgue measure. While the characterization of the infimum is completely clear, the same does not happen for the maximization in the case $q>1$. We prove that for $q$ large enough a maximizing domain exists among quasi-open sets and that the ball is optimal among {\it nearly spherical domains}.


title: What's Wrong with the Absolute Trajectory Error?

abstract: One of the limitations of the commonly used Absolute Trajectory Error (ATE) is that it is highly sensitive to outliers. As a result, in the presence of just a few outliers, it often fails to reflect the varying accuracy as the inlier trajectory error or the number of outliers varies. In this work, we propose an alternative error metric for evaluating the accuracy of the reconstructed camera trajectory. Our metric, named Discernible Trajectory Error (DTE), is computed in five steps: (1) Shift the ground-truth and estimated trajectories such that both of their geometric medians are located at the origin. (2) Rotate the estimated trajectory such that it minimizes the sum of geodesic distances between the corresponding camera orientations. (3) Scale the estimated trajectory such that the median distance of the cameras to their geometric median is the same as that of the ground truth. (4) Compute, winsorize and normalize the distances between the corresponding cameras. (5) Obtain the DTE by taking the average of the mean and the root-mean-square (RMS) of the resulting distances. This metric is an attractive alternative to the ATE, in that it is capable of discerning the varying trajectory accuracy as the inlier trajectory error or the number of outliers varies. Using the similar idea, we also propose a novel rotation error metric, named Discernible Rotation Error (DRE), which has similar advantages to the DTE. Furthermore, we propose a simple yet effective method for calibrating the camera-to-marker rotation, which is needed for the computation of our metrics. Our methods are verified through extensive simulations.


title: Generalization Through the Lens of Learning Dynamics

abstract: A machine learning (ML) system must learn not only to match the output of a target function on a training set, but also to generalize to novel situations in order to yield accurate predictions at deployment. In most practical applications, the user cannot exhaustively enumerate every possible input to the model; strong generalization performance is therefore crucial to the development of ML systems which are performant and reliable enough to be deployed in the real world. While generalization is well-understood theoretically in a number of hypothesis classes, the impressive generalization performance of deep neural networks has stymied theoreticians. In deep reinforcement learning (RL), our understanding of generalization is further complicated by the conflict between generalization and stability in widely-used RL algorithms. This thesis will provide insight into generalization by studying the learning dynamics of deep neural networks in both supervised and reinforcement learning tasks.


title: Neural Continuous-Time Markov Models

abstract: Continuous-time Markov chains are used to model stochastic systems where transitions can occur at irregular times, e.g., birth-death processes, chemical reaction networks, population dynamics, and gene regulatory networks. We develop a method to learn a continuous-time Markov chain's transition rate functions from fully observed time series. In contrast with existing methods, our method allows for transition rates to depend nonlinearly on both state variables and external covariates. The Gillespie algorithm is used to generate trajectories of stochastic systems where propensity functions (reaction rates) are known. Our method can be viewed as the inverse: given trajectories of a stochastic reaction network, we generate estimates of the propensity functions. While previous methods used linear or log-linear methods to link transition rates to covariates, we use neural networks, increasing the capacity and potential accuracy of learned models. In the chemical context, this enables the method to learn propensity functions from non-mass-action kinetics. We test our method with synthetic data generated from a variety of systems with known transition rates. We show that our method learns these transition rates with considerably more accuracy than log-linear methods, in terms of mean absolute error between ground truth and predicted transition rates. We also demonstrate an application of our methods to open-loop control of a continuous-time Markov chain.


title: Persistence of solutions to the Derivative Nonlinear Schr\"odinger equation in weighted Sobolev spaces

abstract: In this paper we show the persistence property for solutions of the derivative nonlinear Schr\"odinger equation with initial data in weighted Sobolev spaces $H^{2}(\mathbb{R})\cap L^2(|x|^{2r}dx)$, $r\in (0,1]$.


title: Mitigating Adversarial Gray-Box Attacks Against Phishing Detectors

abstract: Although machine learning based algorithms have been extensively used for detecting phishing websites, there has been relatively little work on how adversaries may attack such "phishing detectors" (PDs for short). In this paper, we propose a set of Gray-Box attacks on PDs that an adversary may use which vary depending on the knowledge that he has about the PD. We show that these attacks severely degrade the effectiveness of several existing PDs. We then propose the concept of operation chains that iteratively map an original set of features to a new set of features and develop the "Protective Operation Chain" (POC for short) algorithm. POC leverages the combination of random feature selection and feature mappings in order to increase the attacker's uncertainty about the target PD. Using 3 existing publicly available datasets plus a fourth that we have created and will release upon the publication of this paper, we show that POC is more robust to these attacks than past competing work, while preserving predictive performance when no adversarial attacks are present. Moreover, POC is robust to attacks on 13 different classifiers, not just one. These results are shown to be statistically significant at the p < 0.001 level.


title: Hofstadter-Moir\'{e} Butterfly in Twisted Trilayer Graphene

abstract: Mirror symmetric twisted trilayer graphene (tTLG) is composed of even parity twisted bilayer graphene (tBLG)-like bands and odd parity Dirac-like bands. Here, we study the mirror-symmetric and mirror-asymmetric Hofstadter-Moir\'{e} (HM) fractal bands of tTLG. A novel quantum parity Hall state is identified in mirror-symmetric tTLG at experimentally accessible charge densities. This mirror symmetry-protected topological phase exhibits simultaneous quantized Hall and longitudinal resistances. The effects of the displacement field on the HM fractal bands of tTLG and topological phase transitions are also studied. The application of an electric displacement field results in an emergent weakly dispersive band at the charge neutrality point for a range of twist angles. This zero-energy state resides in the middle layer. It is isolated from the HM spectrum by an energy gap that scales proportional to the applied displacement field, making it a prime candidate to host correlated topological states.


title: Railway Scheduling Using Boolean Satisfiability Modulo Simulations

abstract: Railway scheduling is a problem that exhibits both non-trivial discrete and continuous behavior. In this paper, we simulate train networks at a low level, where a number of timing and ordering constraints can appear. We model this problem using a combination of SAT and ordinary differential equations (SAT modulo ODE). In addition, we adapt our existing method for solving such problems in such a way that the resulting solver is competitive with methods based on dedicated railway simulators while being more general and extensible.


title: The stationary critical points of the fractional heat flow

abstract: We study the spatial critical points of the solutions $u=u(x,t)$ of the fractional heat equation. For the Cauchy problem, we show that the origin $0$ satisfies $\nabla_x u(0,t) = 0$ for $t>0$ if and only if the initial data satisfy a balance law of the form $\int_{\mathbb{S}^{N-1}} \omega u_0(r\omega) \, \mathrm{d} \omega=0$ for a. e. $r \ge 0$. Moreover, for the Dirichlet initial-boundary value problem, we prove two symmetry results: $\Omega$ is a ball centered at the origin if and only if $\nabla_x u(0,t) = 0$ for $t>0$ provided that the initial data satisfies the above-mentioned balance law; $\Omega$ is centrosymmetric if and only if $\nabla_x u(0,t) = 0$ for $t>0$ provided that the initial data is centrosymmetric. These results extend some theorems obtained by Magnanini and Sakaguchi in 1997-1999 for the (local) heat equation to the fractional context. These extensions are nontrivial because of the nonlocal nature of the fractional Laplacian. Among others, the proof of the characterization of a ball in the Dirichlet initial-boundary value problem for the fractional heat flow not only works for the classical heat flow but also gives a new insight into the problem.


title: Numerical assessments of a nonintrusive surrogate model based on recurrent neural networks and proper orthogonal decomposition: Rayleigh Benard convection

abstract: Recent developments in diagnostic and computing technologies offer to leverage numerous forms of nonintrusive modeling approaches from data where machine learning can be used to build computationally cheap and accurate surrogate models. To this end, we present a nonlinear proper orthogonal decomposition (POD) framework, denoted as NLPOD, to forge a nonintrusive reduced-order model for the Boussinesq equations. In our NLPOD approach, we first employ the POD procedure to obtain a set of global modes to build a linear-fit latent space and utilize an autoencoder network to compress the projection of this latent space through a nonlinear unsupervised mapping of POD coefficients. Then, long short-term memory (LSTM) neural network architecture is utilized to discover temporal patterns in this low-rank manifold. While performing a detailed sensitivity analysis for hyperparameters of the LSTM model, the trade-off between accuracy and efficiency is systematically analyzed for solving a canonical Rayleigh-Benard convection system.


title: The Clebsch--Gordan coefficients of $U(\mathfrak{sl}_2)$ and the Terwilliger algebras of Johnson graphs

abstract: The universal enveloping algebra $U(\mathfrak{sl}_2)$ of $\mathfrak{sl}_2$ is a unital associative algebra over $\mathbb C$ generated by $E,F,H$ subject to the relations \begin{align*} [H,E]=2E, \qquad [H,F]=-2F, \qquad [E,F]=H. \end{align*} The element $$ \Lambda=EF+FE+\frac{H^2}{2} $$ is called the Casimir element of $U(\mathfrak{sl}_2)$. Let $\Delta:U(\mathfrak{sl}_2)\to U(\mathfrak{sl}_2)\otimes U(\mathfrak{sl}_2)$ denote the comultiplication of $U(\mathfrak{sl}_2)$. The universal Hahn algebra $\mathcal H$ is a unital associative algebra over $\mathbb C$ generated by $A,B,C$ and the relations assert that $[A,B]=C$ and each of \begin{align*} [C,A]+2A^2+B, \qquad [B,C]+4BA+2C \end{align*} is central in $\mathcal H$. Inspired by the Clebsch--Gordan coefficients of $U(\mathfrak{sl}_2)$, we discover an algebra homomorphism $\natural:\mathcal H\to U(\mathfrak{sl}_2)\otimes U(\mathfrak{sl}_2)$ that maps \begin{eqnarray*} A &\mapsto & \frac{H\otimes 1-1\otimes H}{4}, \\ B &\mapsto & \frac{\Delta(\Lambda)}{2}, \\ C &\mapsto & E\otimes F-F\otimes E. \end{eqnarray*} By pulling back via $\natural$ any $U(\mathfrak{sl}_2)\otimes U(\mathfrak{sl}_2)$-module can be considered as an $\mathcal H$-module. For any integer $n\geq 0$ there exists a unique $(n+1)$-dimensional irreducible $U(\mathfrak{sl}_2)$-module $L_n$ up to isomorphism. We study the decomposition of the $\mathcal H$-module $L_m\otimes L_n$ for any integers $m,n\geq 0$. We link these results to the Terwilliger algebras of Johnson graphs. We express the dimensions of the Terwilliger algebras of Johnson graphs in terms of binomial coefficients.


title: A Hierarchical Approach for Investigating Social Features of a City from Mobile Phone Call Detail Records

abstract: Cellphone service-providers continuously collect Call Detail Records (CDR) as a usage log containing spatio-temporal traces of phone users. We proposed a multi-layered hierarchical analytical model for large spatio-temporal datasets and applied that for the progressive exploration of social features of a city, e.g., social activities, relationships, and groups, from CDR. This approach utilizes CDR as the preliminary input for the initial layer, and analytical results from consecutive layers are added to the knowledge-base to be used in the subsequent layers to explore more detailed social features. Each subsequent layer uses the results from previous layers, facilitating the discovery of more in-depth social features not predictable in a single-layered approach using only raw CDR. This model starts with exploring aggregated overviews of the social features and gradually focuses on comprehensive details of social relationships and groups, which facilitates a novel approach for investigating CDR datasets for the progressive exploration of social features in a densely-populated city.


title: General Adversarial Defense Against Black-box Attacks via Pixel Level and Feature Level Distribution Alignments

abstract: Deep Neural Networks (DNNs) are vulnerable to the black-box adversarial attack that is highly transferable. This threat comes from the distribution gap between adversarial and clean samples in feature space of the target DNNs. In this paper, we use Deep Generative Networks (DGNs) with a novel training mechanism to eliminate the distribution gap. The trained DGNs align the distribution of adversarial samples with clean ones for the target DNNs by translating pixel values. Different from previous work, we propose a more effective pixel level training constraint to make this achievable, thus enhancing robustness on adversarial samples. Further, a class-aware feature-level constraint is formulated for integrated distribution alignment. Our approach is general and applicable to multiple tasks, including image classification, semantic segmentation, and object detection. We conduct extensive experiments on different datasets. Our strategy demonstrates its unique effectiveness and generality against black-box attacks.


title: ee$\in$MC: Higher Orders of Radiative Emissions for $e^{+}e^{-} \to \mu^{+}\mu^{-} (n\gamma)$ and $e^{+}e^{-} \to \tau^{+}\tau^{-} (n\gamma)$ Events

abstract: The radiative emissions in the ee$\in$MC generator are extended to include the Initial/Final-State radiative diagrams, with Initial-State/Final-State interference, for the NLO and NNLO calculations and the Initial-State radiative diagrams associated with the NNNLO calculation for $e^{+}e^{-} \to \mu^{+}\mu^{-} (n\gamma)$ and $e^{+}e^{-} \to \tau^{+}\tau^{-} (n\gamma)$ Events. The NNNLO Initial-State radiative diagrams represent the largest contribution to the perturbative Feynman series in the emission of 4 hard-photons. From the convergence of the total cross-section for $e^{+}e^{-} \to \mu^{+}\mu^{-} (n\gamma)$ and $e^{+}e^{-} \to \tau^{+}\tau^{-} (n\gamma)$, we estimate an uncertainty on the theoretical error corresponding to the truncation of the perturbative Feynman series as a function of the soft-photon cut-off applied in the exponentiation using the technique described in [1]. We discuss how this estimation procedure of the theoretical error associated with the truncation of the perturbative Feynman series can be extended to most experimentally measurable physical observables and the potential pitfalls of this strategy.


title: Manifestation of the coupling phase in microwave cavity magnonics

abstract: The interaction between microwave photons and magnons is well understood and originates from the Zeeman coupling between spins and a magnetic field. Interestingly, the magnon/photon interaction is accompanied by a phase factor which can usually be neglected. However, under the rotating wave approximation, if two magnon modes simultaneously couple with two cavity resonances, this phase cannot be ignored as it changes the physics of the system. We consider two such systems, each differing by the sign of one of the magnon/photon coupling strengths. This simple difference, originating from the various coupling phases in the system, is shown to preserve, or destroy, two potential applications of hybrid photon/magnon systems, namely dark mode memories and cavity-mediated coupling. The observable consequences of the coupling phase in this system is akin to the manifestation of a discrete Pancharatnam-Berry phase, which may be useful for quantum information processing.


title: Exposing new scalars hiding behind the Higgs boson

abstract: It is possible that there is another scalar hiding behind the known 125 GeV Higgs boson. If the hidden scalar exhibits a CP property different from the Higgs boson, it can be exposed in the di-Higgs production at the high-luminosity large hadron collider and future colliders.


title: A forbidden subgraph characterization of phylogeny graphs of degree bounded digraphs

abstract: An acyclic digraph in which every vertex has indegree at most $i$ and outdegree at most $j$ is called an $(i,j)$ digraph for some positive integers $i$ and $j$. The phylogeny graph of a digraph $D$ has $V(D)$ as the vertex set and an edge $uv$ if and only if one of the following is true: $(u,v) \in A(D)$; $(v,u) \in A(D)$; $(u,w) \in A(D)$ and $(v,w) \in A(D)$ for some $w \in V(D)$. A graph $G$ is a phylogeny graph (resp. an $(i,j)$ phylogeny graph) if there is an acyclic digraph $D$ (resp. an $(i,j)$ digraph $D$) such that the phylogeny graph of $D$ is isomorphic to $G$. Lee~{\em et al.} (2017) and Eoh and Kim (2021) studied the $(2,2)$ phylogeny graphs, $(1,j)$ phylogeny graphs, $(i,1)$ phylogeny graphs, and $(2,j)$ phylogeny graphs. Their work was motivated by problems related to evidence propagation in a Bayesian network for which it is useful to know which acyclic digraphs have chordal moral graphs (phylogeny graphs are called moral graphs in Bayesian network theory). In this paper, we extend their work by characterizing chordal $(i,2)$ phylogeny graphs. We go further to completely characterize $(i,j)$ phylogeny graphs by listing the forbidden induced subgraphs.


title: Mean Rational Approximation for Some Compact Planar Subsets

abstract: In 1991, J. Thomson obtained celebrated structural results for $P^t(\mu).$ Later, J. Brennan (2008) generalized Thomson's theorem to $R^t(K,\mu)$ when the diameters of the components of $\mathbb C\setminus K$ are bounded below. The results indicate that if $R^t(K,\mu)$ is pure, then $R^t(K,\mu) \cap L^\infty (\mu)$ is the "same as" the algebra of bounded analytic functions on $\mbox{abpe}(R^t(K, \mu)),$ the set of analytic bounded point evaluations. We show that if the diameters of the components of $\mathbb C\setminus K$ are allowed to tend to zero, then even though $\text{int}(K) = \mbox{abpe}(R^t(K, \mu))$ and $K =\overline {\text{int}(K)},$ the algebra $R^t(K,\mu) \cap L^\infty (\mu)$ may "be equal to" a proper sub-algebra of bounded analytic functions on $\text{int}(K),$ where functions in the sub-algebra are "continuous" on certain portions of the inner boundary of $K.$


title: Light Scattering on Two Parallel Subwavelength Cylinders

abstract: The plasmon resonance has found important application in various systems, e.g., nanoantennas, solar panels, refractive index sensors. Unfortunately, a few analytical solutions for such systems are known. The work aims to find a solution for scattering by a plane electromagnetic wave on two parallel cylinders. When their diameters and the gap between them are less than the radiation wavelength, the quasistatic approximation is valid. We build up a conformal transformation that maps Cartesian into bipolar orthogonal coordinates and represent the scattered field as a decomposition by eigenfunctions of the Laplace operator. The near-field intensity distribution is shown to coincide with numerical calculation performed by COMSOL Multiphysics. Green's function obtained allows one to find also higher decomposition orders. Compared to previous studies, we treat the general case of cylinders with different diameters and dielectric constants.


title: Spectral asymptotics for kinetic Brownian motion on Riemannian manifolds

abstract: We prove the convergence of the spectrum of the generator of the kinetic Brownian motion to the spectrum of the base Laplacian for closed Riemannian manifolds. This generalizes recent work of Kolb--Weich--Wolf [arXiv:2011.06434] on constant curvature surfaces and of Ren--Tao [arXiv:2208.13111] on locally symmetric spaces. As an application, we prove a conjecture of Baudoin--Tardif [arXiv:1604.06813] on the optimal convergence rate to the equilibrium.


title: Tropicalization of the mirror curve near the large radius limit

abstract: The mirror of a toric orbifold is an affine curve called the mirror curve. In this paper, firstly, we recall the basic tools in tropical geometry and give a definition of the mirror curve. Then we calculate the tropical spine of the mirror curve for a smooth toric Calabi-Yau 3-fold near the large radius limit. Finally, we recall a special kind of real algebraic curves called the cyclic-M curve and show that under some special choices of parameters near the large radius limit, the mirror curve is a cyclic-M curve. Applying Mikhalkin's result of cyclic-M curves, we show that the mirror curve is glued from tubes and pairs of pants.


title: Computational screening of cathode materials for Zn-ion rechargeable batteries

abstract: We propose a comprehensive set of indicators (including methods to obtain and analyse them) for computational screening of candidate cathode materials for rechargeable Zn-ion aqueous batteries relying on Zn$^{2+}$ intercalation processes. The indicators capture feasibility of Zn$^{2+}$ intercalation and transport within the material, the thermodynamic stability of charged and discharged material structures, electrochemical stability of the cathode material and electrolyte, volume expansion, and energy storage capacity. The approach was applied to well-known cathode materials ($\alpha$-MnO$_2$ and V$_2$O$_5$) as well as some potential alternatives (MoS$_2$, ZrP$_2$O$_7$, MoO$_3$, and FeO$_2$) to demonstrate the screening workflow and the decision making process. We show that selection of cathode materials for Zn-ion aqueous rechargeable batteries is a multifaceted problem, and first principle calculations can help to narrow down the search. Despite us being unable to identify a particularly successful cathode material, tools and techniques developed in this work can be applied more broadly to screen a wider array of potential material compositions and structures, with the goal of identifying next generation cathode materials for aqueous rechargeable batteries with the intercalation energy storage mechanism not limited to Zn$^{2+}$ ions.


title: Task modules Partitioning, Scheduling and Floorplanning for Partially Dynamically Reconfigurable Systems Based on Modern Heterogeneous FPGAs

abstract: Modern field programmable gate array(FPGA) can be partially dynamically reconfigurable with heterogeneous resources distributed on the chip. And FPGA-based partially dynamically reconfigurable system(FPGA-PDRS) can be used to accelerate computing and improve computing flexibility. However, the traditional design of FPGA-PDRS is based on manual design. Implementing the automation of FPGA-PDRS needs to solve the problems of task modules partitioning, scheduling, and floorplanning on heterogeneous resources. Existing works only partly solve problems for the automation process of FPGA-PDRS or model homogeneous resource for FPGA-PDRS. To better solve the problems in the automation process of FPGA-PDRS and narrow the gap between algorithm and application, in this paper, we propose a complete workflow including three parts, pre-processing to generate the list of task modules candidate shapes according to the resources requirements, exploration process to search the solution of task modules partitioning, scheduling, and floorplanning, and post-optimization to improve the success rate of floorplan. Experimental results show that, compared with state-of-the-art work, the proposed complete workflow can improve performance by 18.7\%, reduce communication cost by 8.6\%, on average, with improving the resources reuse rate of the heterogeneous resources on the chip. And based on the solution generated by the exploration process, the post-optimization can improve the success rate of the floorplan by 14\%.


title: On Groups in the Qubit Clifford Hierarchy

abstract: Here we study the unitary groups that can be constructed using elements from the qubit Clifford Hierarchy. We first provide a necessary and sufficient canonical form that semi-Clifford and generalized semi-Clifford elements must satisfy to be in the Clifford Hierarchy. Then we classify the groups that can be formed from such elements. Up to Clifford conjugation, we classify all such groups that can be constructed using generalized semi-Clifford elements in the Clifford Hierarchy. We discuss a possible minor exception to this classification in the appendix. This may not be a full classification of all groups in the qubit Clifford Hierarchy as it is not currently known if all elements in the Clifford Hierarchy must be generalized semi-Clifford. In addition to the diagonal gate groups found by Cui et al., we show that many non-isomorphic (to the diagonal gate groups) generalized symmetric groups are also contained in the Clifford Hierarchy. Finally, as an application of this classification, we examine restrictions on transversal gates given by the structure of the groups enumerated herein which may be of independent interest.


title: Untargeted Attack against Federated Recommendation Systems via Poisonous Item Embeddings and the Defense

abstract: Federated recommendation (FedRec) can train personalized recommenders without collecting user data, but the decentralized nature makes it susceptible to poisoning attacks. Most previous studies focus on the targeted attack to promote certain items, while the untargeted attack that aims to degrade the overall performance of the FedRec system remains less explored. In fact, untargeted attacks can disrupt the user experience and bring severe financial loss to the service provider. However, existing untargeted attack methods are either inapplicable or ineffective against FedRec systems. In this paper, we delve into the untargeted attack and its defense for FedRec systems. (i) We propose ClusterAttack, a novel untargeted attack method. It uploads poisonous gradients that converge the item embeddings into several dense clusters, which make the recommender generate similar scores for these items in the same cluster and perturb the ranking order. (ii) We propose a uniformity-based defense mechanism (UNION) to protect FedRec systems from such attacks. We design a contrastive learning task that regularizes the item embeddings toward a uniform distribution. Then the server filters out these malicious gradients by estimating the uniformity of updated item embeddings. Experiments on two public datasets show that ClusterAttack can effectively degrade the performance of FedRec systems while circumventing many defense methods, and UNION can improve the resistance of the system against various untargeted attacks, including our ClusterAttack.


title: How to Backdoor Diffusion Models?

abstract: Diffusion models are state-of-the-art deep learning empowered generative models that are trained based on the principle of learning forward and reverse diffusion processes via progressive noise-addition and denoising. To gain a better understanding of the limitations and potential risks, this paper presents the first study on the robustness of diffusion models against backdoor attacks. Specifically, we propose BadDiffusion, a novel attack framework that engineers compromised diffusion processes during model training for backdoor implantation. At the inference stage, the backdoored diffusion model will behave just like an untampered generator for regular data inputs, while falsely generating some targeted outcome designed by the bad actor upon receiving the implanted trigger signal. Such a critical risk can be dreadful for downstream tasks and applications built upon the problematic model. Our extensive experiments on various backdoor attack settings show that BadDiffusion can consistently lead to compromised diffusion models with high utility and target specificity. Even worse, BadDiffusion can be made cost-effective by simply finetuning a clean pre-trained diffusion model to implant backdoors. We also explore some possible countermeasures for risk mitigation. Our results call attention to potential risks and possible misuse of diffusion models. Our code is available on https://github.com/IBM/BadDiffusion.


title: Characterizing the Identity of Model-based Safety Assessment: A Systematic Analysis

abstract: Model-based safety assessment has been one of the leading research thrusts of the System Safety Engineering community for over two decades. However, there is still a lack of consensus on what MBSA is. The ambiguity in the identity of MBSA impedes the advancement of MBSA as an active research area. For this reason, this paper aims to investigate the identity of MBSA to help achieve a consensus across the community. Towards this end, we first reason about the core activities that an MBSA approach must conduct. Second, we characterize the core patterns in which the core activities must be conducted for an approach to be considered MBSA. Finally, a recently published MBSA paper is reviewed to test the effectiveness of our characterization of MBSA.


title: Stochastic First-Order Learning for Large-Scale Flexibly Tied Gaussian Mixture Model

abstract: Gaussian Mixture Models (GMMs) are one of the most potent parametric density models used extensively in many applications. Flexibly-tied factorization of the covariance matrices in GMMs is a powerful approach for coping with the challenges of common GMMs when faced with high-dimensional data and complex densities which often demand a large number of Gaussian components. However, the expectation-maximization algorithm for fitting flexibly-tied GMMs still encounters difficulties with streaming and very large dimensional data. To overcome these challenges, this paper suggests the use of first-order stochastic optimization algorithms. Specifically, we propose a new stochastic optimization algorithm on the manifold of orthogonal matrices. Through numerous empirical results on both synthetic and real datasets, we observe that stochastic optimization methods can outperform the expectation-maximization algorithm in terms of attaining better likelihood, needing fewer epochs for convergence, and consuming less time per each epoch.


title: Multi-Task Predict-then-Optimize

abstract: The predict-then-optimize framework arises in a wide variety of applications where the unknown cost coefficients of an optimization problem are first predicted based on contextual features and then used to solve the problem. In this work, we extend the predict-then-optimize framework to a multi-task setting: contextual features must be used to predict cost coefficients of multiple optimization problems, possibly with different feasible regions, simultaneously. For instance, in a vehicle dispatch/routing application, features such as time-of-day, traffic, and weather must be used to predict travel times on the edges of a road network for multiple traveling salesperson problems that span different target locations and multiple s-t shortest path problems with different source-target pairs. We propose a set of methods for this setting, with the most sophisticated one drawing on advances in multi-task deep learning that enable information sharing between tasks for improved learning, particularly in the small-data regime. Our experiments demonstrate that multi-task predict-then-optimize methods provide good tradeoffs in performance among different tasks, particularly with less training data and more tasks.


title: Cap2Aug: Caption guided Image to Image data Augmentation

abstract: Visual recognition in a low-data regime is challenging and often prone to overfitting. To mitigate this issue, several data augmentation strategies have been proposed. However, standard transformations, e.g., rotation, cropping, and flipping provide limited semantic variations. To this end, we propose Cap2Aug, an image-to-image diffusion model-based data augmentation strategy using image captions as text prompts. We generate captions from the limited training images and using these captions edit the training images using an image-to-image stable diffusion model to generate semantically meaningful augmentations. This strategy generates augmented versions of images similar to the training images yet provides semantic diversity across the samples. We show that the variations within the class can be captured by the captions and then translated to generate diverse samples using the image-to-image diffusion model guided by the captions. However, naive learning on synthetic images is not adequate due to the domain gap between real and synthetic images. Thus, we employ a maximum mean discrepancy (MMD) loss to align the synthetic images to the real images for minimizing the domain gap. We evaluate our method on few-shot and long-tail classification tasks and obtain performance improvements over state-of-the-art, especially in the low-data regimes.


title: Scattering and Rigidity for Nonlinear Elastic Waves

abstract: For the Cauchy problem of nonlinear elastic wave equations of three dimensional isotropic, homogeneous and hyperelastic materials satisfying the null condition, global existence of classical solutions with small initial data was proved in R. Agemi (Invent. Math. 142 (2000) 225--250) and T. C. Sideris (Ann. Math. 151(2000) 849--874), independently. In this paper, we will consider the asymptotic behavior of global solutions. We first show that the global solution will scatter, i.e., it will converge to some solution of linear elastic wave equations as time tends to infinity, in the energy sense. We also prove the following rigidity result: if the scattering data vanish, then the global solution will also vanish identically. The variational structure of the system will play a key role in our argument.


title: The Effect of Splashback on Weak Lensing Mass Estimates of Galaxy Clusters and Groups

abstract: The splashback radius of a dark matter halo, which corresponds to the first apocenter radius reached by infalling matter and substructures, has been detected around galaxy clusters using a multitude of observational methods, including weak lensing measurements. In this manuscript, we present how the splashback feature in the halo density profile affects galaxy cluster masses derived through weak lensing measurements if it is not accounted for. We find that the splashback radius has an increasingly large effect on group-sized halos towards $M_{200m} \sim 10^{13.5} \mathrm{M_\odot}$. Depending on the model and the radial scale used, the cluster/group masses can be biased low by more than 0.1 dex. This bias, in turn, would result in a slightly lower $\Omega_m$ value if propagated into a cluster cosmology analysis. The splashback effect with group-sized dark matter halos may become important to consider, given the increasingly stringent cosmological constraints coming from optical wide-field surveys.


title: High-wavenumber steady solutions of two-dimensional Rayleigh--B\'enard convection between stress-free boundaries

abstract: Recent investigations show that steady solutions share many features with turbulent Rayleigh--B\'enard convection (RBC) and form the state space skeleton of turbulent dynamics. Previous computations of steady roll solutions in two-dimensional (2D) RBC between no-slip boundaries reveal that for fixed Rayleigh number $Ra$ and Prandtl number $Pr$, the heat-flux-maximizing solution is always in the high-wavenumber regime. In this study, we explore the high-wavenumber steady convection roll solutions that bifurcate supercritically from the motionless conductive state for 2D RBC between stress-free boundaries. Our computations confirm the existence of a local heat-flux-maximizing solution in the high-wavenumber regime. To elucidate the asymptotic properties of this solution, we perform computations over eight orders of magnitude in the Rayleigh number, $10^{8} \le Ra \le 10^{16.5}$, and two orders of magnitude in the Prandtl number, $10^{-1} \leq Pr \leq 10^{3/2}$. The numerical results indicate that as $Ra\to\infty$, the local heat-flux-maximizing aspect ratio $\Gamma^*_{loc}\simeq Ra^{-1/4}$, the Nusselt number $Nu(\Gamma^*_{loc})\simeq Ra^{0.29}$, and the Reynolds number $Re(\Gamma^*_{loc})\simeq Pr^{-1}Ra^{2/5}$, with all prefactors depending on $Pr$. Moreover, the interior flow of the local $Nu$-maximizing solution can be well described by an analytical heat-exchanger solution, and the connection to the high-wavenumber asymptotic solution given by Blennerhassett & Bassom is discussed. With a fixed aspect ratio $0.06\le\Gamma\le\pi/5$ at $Pr=1$, however, our computations show that as $Ra$ increases, the steady rolls converge to the semi-analytical asymptotic solutions constructed by Chini & Cox, with scalings $Nu\sim Ra^{1/3}$ and $Re\sim Pr^{-1}Ra^{2/3}$. Finally, a phase diagram is delineated to gain a panorama of steady solutions in the high-Rayleigh-number-wavenumber plane.


title: Finite $N$ indices and the giant graviton expansion

abstract: The superconformal index of $\mathcal N=4$ super-Yang Mills theory with $U(N)$ gauge group can be written as a matrix integral over the gauge group. Recently, Murthy demonstrated that this integral can be reexpressed as a sum of terms corresponding to a giant graviton expansion of the index, and provided an explicit formula for the case of a single giant graviton. Here we give similar explicit formulae for an arbitrary number, $m\ge1$, of giant gravitons. We provide 1/2 and 1/16 BPS index examples up to the order where three giant gravitons contribute and demonstrate that the expansion of the matrix integral differs from the giant graviton expansion computed in the supergravity dual. This shows that the giant graviton expansion is not necessarily unique once two or more giant gravitons start appearing.


title: Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languages

abstract: Building Natural Language Understanding (NLU) capabilities for Indic languages, which have a collective speaker base of more than one billion speakers is absolutely crucial. In this work, we aim to improve the NLU capabilities of Indic languages by making contributions along 3 important axes (i) monolingual corpora (ii) NLU testsets (iii) multilingual LLMs focusing on Indic languages. Specifically, we curate the largest monolingual corpora, IndicCorp, with 20.9B tokens covering 24 languages from 4 language families - a 2.3x increase over prior work, while supporting 12 additional languages. Next, we create a human-supervised benchmark, IndicXTREME, consisting of nine diverse NLU tasks covering 20 languages. Across languages and tasks, IndicXTREME contains a total of 105 evaluation sets, of which 52 are new contributions to the literature. To the best of our knowledge, this is the first effort towards creating a standard benchmark for Indic languages that aims to test the multilingual zero-shot capabilities of pretrained language models. Finally, we train IndicBERT v2, a state-of-the-art model supporting all the languages. Averaged across languages and tasks, the model achieves an absolute improvement of 2 points over a strong baseline. The data and models are available at https://github.com/AI4Bharat/IndicBERT.


title: ABC: Aggregation before Communication, a Communication Reduction Framework for Distributed Graph Neural Network Training and Effective Partition

abstract: Graph Neural Networks(GNNs) are a family of neural models tailored for graph-structure data and have shown superior performance in learning representations for graph-structured data. However, training GNNs on large graphs remains challenging and a promising direction is distributed GNN training, which is to partition the input graph and distribute the workload across multiple machines. The key bottleneck of the existing distributed GNNs training framework is the across-machine communication induced by the dependency on the graph data and aggregation operator of GNNs. In this paper, we study the communication complexity during distributed GNNs training and propose a simple lossless communication reduction method, termed the Aggregation before Communication (ABC) method. ABC method exploits the permutation-invariant property of the GNNs layer and leads to a paradigm where vertex-cut is proved to admit a superior communication performance than the currently popular paradigm (edge-cut). In addition, we show that the new partition paradigm is particularly ideal in the case of dynamic graphs where it is infeasible to control the edge placement due to the unknown stochastic of the graph-changing process.


title: Authoring Platform for Mobile Citizen Science Apps with Client-side ML

abstract: Data collection is an integral part of any citizen science project. Given the wide variety of projects, some level of expertise or, alternatively, some guidance for novice participants can greatly improve the quality of the collected data. A significant portion of citizen science projects depends on visual data, where photos or videos of different subjects are needed. Often these visual data are collected from all over the world, including remote locations. In this article, we introduce an authoring platform for easily creating mobile apps for citizen science projects that are empowered with client-side machine learning (ML) guidance. The apps created with our platform can help participants recognize the correct data and increase the efficiency of the data collection process. We demonstrate the application of our proposed platform with two use cases: a rip current detection app for a planned pilot study and a detection app for biodiversity-related projects.


title: A Hierarchical Temporal Planning-Based Approach for Dynamic Hoist Scheduling Problems

abstract: Hoist scheduling has become a bottleneck in electroplating industry applications with the development of autonomous devices. Although there are a few approaches proposed to target at the challenging problem, they generally cannot scale to large-scale scheduling problems. In this paper, we formulate the hoist scheduling problem as a new temporal planning problem in the form of adapted PDDL, and propose a novel hierarchical temporal planning approach to efficiently solve the scheduling problem. Additionally, we provide a collection of real-life benchmark instances that can be used to evaluate solution methods for the problem. We exhibit that the proposed approach is able to efficiently find solutions of high quality for large-scale real-life benchmark instances, with comparison to state-of-the-art baselines.


title: Spin Excitation in Coupled Honeycomb Lattice Ni$_2$InSbO$_6$

abstract: We performed an inelastic neutron scattering experiment on a polycrystalline sample of a helimagnet Ni$_2$InSbO$_6$ to construct the spin Hamiltonian. Well-defined spin-wave excitation with a band energy of 20 meV was observed below $T_{N} = 76$ K. Using the linear spin-wave theory, the spectrum was reasonably reproduced with honeycomb spin layers coupled along the stacking axis (the $c$ axis). The proposed spin model reproduces the soliton lattice induced by a magnetic field applied perpendicular to the $c$ axis.


title: Nash Entropy and Heat Kernel on Generalized Ricci Flow

abstract: We introduce analogous geometric quantities and prove some geometric and analytic bounds in [Bam20a] to generalized Ricci flow.


title: Predicting article quality scores with machine learning: The UK Research Excellence Framework

abstract: National research evaluation initiatives and incentive schemes have previously chosen between simplistic quantitative indicators and time-consuming peer review, sometimes supported by bibliometrics. Here we assess whether artificial intelligence (AI) could provide a third alternative, estimating article quality using more multiple bibliometric and metadata inputs. We investigated this using provisional three-level REF2021 peer review scores for 84,966 articles submitted to the UK Research Excellence Framework 2021, matching a Scopus record 2014-18 and with a substantial abstract. We found that accuracy is highest in the medical and physical sciences Units of Assessment (UoAs) and economics, reaching 42% above the baseline (72% overall) in the best case. This is based on 1000 bibliometric inputs and half of the articles used for training in each UoA. Prediction accuracies above the baseline for the social science, mathematics, engineering, arts, and humanities UoAs were much lower or close to zero. The Random Forest Classifier (standard or ordinal) and Extreme Gradient Boosting Classifier algorithms performed best from the 32 tested. Accuracy was lower if UoAs were merged or replaced by Scopus broad categories. We increased accuracy with an active learning strategy and by selecting articles with higher prediction probabilities, as estimated by the algorithms, but this substantially reduced the number of scores predicted.


title: In which fields are citations indicators of research quality?

abstract: Citation counts are widely used as indicators of research quality to support or replace human peer review and for lists of top cited papers, researchers, and institutions. Nevertheless, the relationship between citations and research quality is poorly evidenced. We report the first large-scale science-wide academic evaluation of the relationship between research quality and citations (field normalised citation counts), correlating them for 87,739 journal articles in 34 field-based UK Units of Assessment (UoAs). The two correlate positively in all academic fields, from very weak (0.1) to strong (0.5), reflecting broadly linear relationships in all fields. We give the first evidence that the correlations are positive even across the arts and humanities. The patterns are similar for the field classification schemes of Scopus and Dimensions.ai, although varying for some individual subjects and therefore more uncertain for these. We also show for the first time that no field has a citation threshold beyond which all articles are excellent quality, so lists of top cited articles are not pure collections of excellence, and neither is any top citation percentile indicator. Thus, whilst appropriately field normalised citations associate positively with research quality in all fields, they never perfectly reflect it, even at high values.


title: Which international co-authorships produce higher quality journal articles?

abstract: International collaboration is sometimes encouraged in the belief that it generates higher quality research or is more capable of addressing societal problems. Nevertheless, while there is evidence that the journal articles of international teams tend to be more cited than average, perhaps from increased international audiences, there is no science-wide direct academic evidence of a connection between international collaboration and research quality. This article empirically investigates the connection between international collaboration and research quality for the first time, with 148,977 UK-based journal articles with post publication expert review scores from the 2021 Research Excellence Framework (REF). Using an ordinal regression model controlling for collaboration, international partners increased the odds of higher quality scores in 27 out of 34 Units of Assessment (UoAs) and all Main Panels. The results therefore give the first large scale evidence of the fields in which international co-authorship for articles is usually apparently beneficial. At the country level, the results suggests that UK collaboration with other high research-expenditure economies generates higher quality research, even when the countries produce lower citation impact journal articles than the United Kingdom. Worryingly, collaborations with lower research-expenditure economies tend to be judged lower quality, possibly through misunderstanding Global South research goals.


title: Is Research Funding Always Beneficial? A Cross-Disciplinary Analysis of UK Research 2014-20

abstract: The search for and management of external funding now occupies much valuable researcher time. Whilst funding is essential for some types of research and beneficial for others, it may also constrain academic choice and creativity. Thus, it is important to assess whether it is ever detrimental or unnecessary. Here we investigate whether funded research tends to be higher quality in all fields and for all major research funders. Based on peer review quality scores for 113,877 articles from all fields in the UK's Research Excellence Framework (REF) 2021, we estimate that there are substantial disciplinary differences in the proportion of funded journal articles, from Theology and Religious Studies (16%+) to Biological Sciences (91%+). The results suggest that funded research is likely to be higher quality overall, for all the largest research funders, and for all fields, even after factoring out research team size. There are differences between funders in the average quality of the research they support, however. Funding seems particularly beneficial in health-related fields. The results do not show cause and effect and do not take into account the amount of funding received but are consistent with funding either improving research quality or being won by high quality researchers or projects. In summary, there are no broad fields of research in which funding is irrelevant, so no fields can afford to ignore it. The results also show that citations are not effective proxies for research quality in the arts and humanities and most social sciences for evaluating research funding.


title: In which fields do higher impact journals publish higher quality articles?

abstract: The Journal Impact Factor and other indicators that assess the average citation rate of articles in a journal are consulted by many academics and research evaluators, despite initiatives against overreliance on them. Despite this, there is limited evidence about the extent to which journal impact indicators in any field relates to human judgements about the journals or their articles. In response, we compared average citation rates of journals against expert judgements of their articles in all fields of science. We used preliminary quality scores for 96,031 articles published 2014-18 from the UK Research Excellence Framework (REF) 2021. We show that whilst there is a positive correlation between expert judgements of article quality and average journal impact in all fields of science, it is very weak in many fields and is never strong. The strength of the correlation varies from 0.11 to 0.43 for the 27 broad fields of Scopus. The highest correlation for the 94 Scopus narrow fields with at least 750 articles was only 0.54, for Infectious Diseases, and there was only one negative correlation, for the mixed category Computer Science (all). The results suggest that the average citation impact of a Scopus-indexed journal is never completely irrelevant to the quality of an article, even though it is never a strong indicator of article quality.


title: Terms in journal articles associating with high quality: Can qualitative research be world-leading?

abstract: Purpose: Scholars often aim to conduct high quality research and their success is judged primarily by peer reviewers. Research quality is difficult for either group to identify, however, and misunderstandings can reduce the efficiency of the scientific enterprise. In response, we use a novel term association strategy to seek quantitative evidence of aspects of research that associate with high or low quality. Design/methodology/approach: We extracted the words and 2-5-word phrases most strongly associating with different quality scores in each of 34 Units of Assessment (UoAs) in the Research Excellence Framework (REF) 2021. We extracted the terms from 122,331 journal articles 2014-2020 with individual REF2021 quality scores. Findings: The terms associating with high- or low-quality scores vary between fields but relate to writing styles, methods, and topics. We show that the first-person writing style strongly associates with higher quality research in many areas because it is the norm for a set of large prestigious journals. We found methods and topics that associate with both high- and low-quality scores. Worryingly, terms associating with educational and qualitative research attract lower quality scores in multiple areas. REF experts may rarely give high scores to qualitative or educational research because the authors tend to be less competent, because it is harder to make world leading research with these themes, or because they do not value them. Originality: This is the first investigation of journal article terms associating with research quality.


title: Feature-Level Debiased Natural Language Understanding

abstract: Natural language understanding (NLU) models often rely on dataset biases rather than intended task-relevant features to achieve high performance on specific datasets. As a result, these models perform poorly on datasets outside the training distribution. Some recent studies address this issue by reducing the weights of biased samples during the training process. However, these methods still encode biased latent features in representations and neglect the dynamic nature of bias, which hinders model prediction. We propose an NLU debiasing method, named debiasing contrastive learning (DCT), to simultaneously alleviate the above problems based on contrastive learning. We devise a debiasing, positive sampling strategy to mitigate biased latent features by selecting the least similar biased positive samples. We also propose a dynamic negative sampling strategy to capture the dynamic influence of biases by employing a bias-only model to dynamically select the most similar biased negative samples. We conduct experiments on three NLU benchmark datasets. Experimental results show that DCT outperforms state-of-the-art baselines on out-of-distribution datasets while maintaining in-distribution performance. We also verify that DCT can reduce biased latent features from the model's representation.


title: Teaching What You Should Teach: A Data-Based Distillation Method

abstract: In real teaching scenarios, an excellent teacher always teaches what he (or she) is good at but the student is not. This gives the student the best assistance in making up for his (or her) weaknesses and becoming a good one overall. Enlightened by this, we introduce the "Teaching what you Should Teach" strategy into a knowledge distillation framework, and propose a data-based distillation method named "TST" that searches for desirable augmented samples to assist in distilling more efficiently and rationally. To be specific, we design a neural network-based data augmentation module with priori bias, which assists in finding what meets the teacher's strengths but the student's weaknesses, by learning magnitudes and probabilities to generate suitable data samples. By training the data augmentation module and the generalized distillation paradigm in turn, a student model is learned with excellent generalization ability. To verify the effectiveness of our method, we conducted extensive comparative experiments on object recognition, detection, and segmentation tasks. The results on the CIFAR-10, ImageNet-1k, MS-COCO, and Cityscapes datasets demonstrate that our method achieves state-of-the-art performance on almost all teacher-student pairs. Furthermore, we conduct visualization studies to explore what magnitudes and probabilities are needed for the distillation process.


title: Layer-dependent optically-induced spin polarization in InSe

abstract: Optical control of spin in semiconductors has been pioneered using nanostructures of III-V and II-VI semiconductors, but the emergence of two-dimensional van der Waals materials offers an alternative low-dimensional platform for spintronic phenomena. Indium selenide (InSe), a group-III monochalcogenide van der Waals material, has shown promise for opto-electronics due to its high electron mobility, tunable direct bandgap, and quantum transport. There are predictions of spin-dependent optical selection rules suggesting potential for all-optical excitation and control of spin in a two-dimensional layered material. Despite these predictions, layer-dependent optical spin phenomena in InSe have yet to be explored. Here, we present measurements of layer-dependent optical spin dynamics in few-layer and bulk InSe. Polarized photoluminescence reveals layer-dependent optical orientation of spin, thereby demonstrating the optical selection rules in few-layer InSe. Spin dynamics are also studied in many-layer InSe using time-resolved Kerr rotation spectroscopy. By applying out-of-plane and in-plane static magnetic fields for polarized emission measurements and Kerr measurements, respectively, the $g$-factor for InSe was extracted. Further investigations are done by calculating precession values using a $\textbf{k} \cdot \textbf{p}$ model, which is supported by \textit{ab-initio} density functional theory. Comparison of predicted precession rates with experimental measurements highlights the importance of excitonic effects in InSe for understanding spin dynamics. Optical orientation of spin is an important prerequisite for opto-spintronic phenomena and devices, and these first demonstrations of layer-dependent optical excitation of spins in InSe lay the foundation for combining layer-dependent spin properties with advantageous electronic properties found in this material.


title: On regression-adjusted imputation estimators of the average treatment effect

abstract: Imputing missing potential outcomes using an estimated regression function is a natural idea for estimating causal effects. In the literature, estimators that combine imputation and regression adjustments are believed to be comparable to augmented inverse probability weighting. Accordingly, people for a long time conjectured that such estimators, while avoiding directly constructing the weights, are also doubly robust (Imbens, 2004; Stuart, 2010). Generalizing an earlier result of the authors (Lin et al., 2021), this paper formalizes this conjecture, showing that a large class of regression-adjusted imputation methods are indeed doubly robust for estimating the average treatment effect. In addition, they are provably semiparametrically efficient as long as both the density and regression models are correctly specified. Notable examples of imputation methods covered by our theory include kernel matching, (weighted) nearest neighbor matching, local linear matching, and (honest) random forests.


title: Topological band inversion in HgTe(001): surface and bulk signatures from photoemission

abstract: HgTe is a versatile topological material and has enabled the realization of a variety of topological states, including two- and three-dimensional (3D) topological insulators and topological semimetals. Nevertheless, a quantitative understanding of its electronic structure remains challenging, in particular due to coupling of the Te 5p-derived valence electrons to Hg 5d core states at shallow binding energy. We present a joint experimental and theoretical study of the electronic structure in strained HgTe(001) films in the 3D topological-insulator regime, based on angle-resolved photoelectron spectroscopy and density functional theory. The results establish detailed agreement in terms of (i) electronic band dispersions and orbital symmetries, (ii) surface and bulk contributions to the electronic structure, and (iii) the importance of Hg 5d states in the valence-band formation. Supported by theory, our experiments directly image the paradigmatic band inversion in HgTe, underlying its non-trivial band topology.


title: Asymptotic estimates for double-coverings

abstract: A collection of finite sets $\{A_1, A_2,\ldots, A_{p}\}$ is said to be a double-covering if each $a\in \cup_{k=1}^{p}A_k$ is included in exactly two sets of the collection. For fixed integers $l$ and $p$, let $\mu_{l,p}$ be the number of equivalency classes of double-coverings with $\#(A_k)=l$, $k=1,2,\ldots,p$. We characterize the asymptotic behavior of the quantity $\mu_{l,p}$ as $p\to \infty$. The results are applied to give an alternative approach to the Bonami-Kiener hypercontraction inequality.


title: Statistical guarantees for sparse deep learning

abstract: Neural networks are becoming increasingly popular in applications, but our mathematical understanding of their potential and limitations is still limited. In this paper, we further this understanding by developing statistical guarantees for sparse deep learning. In contrast to previous work, we consider different types of sparsity, such as few active connections, few active nodes, and other norm-based types of sparsity. Moreover, our theories cover important aspects that previous theories have neglected, such as multiple outputs, regularization, and l2-loss. The guarantees have a mild dependence on network widths and depths, which means that they support the application of sparse but wide and deep networks from a statistical perspective. Some of the concepts and tools that we use in our derivations are uncommon in deep learning and, hence, might be of additional interest.