title: Transformers in Action: Weakly Supervised Action Segmentation

abstract: The video action segmentation task is regularly explored under weaker forms of supervision, such as transcript supervision, where a list of actions is easier to obtain than dense frame-wise labels. In this formulation, the task presents various challenges for sequence modeling approaches due to the emphasis on action transition points, long sequence lengths, and frame contextualization, making the task well-posed for transformers. Given developments enabling transformers to scale linearly, we demonstrate through our architecture how they can be applied to improve action alignment accuracy over the equivalent RNN-based models with the attention mechanism focusing around salient action transition regions. Additionally, given the recent focus on inference-time transcript selection, we propose a supplemental transcript embedding approach to select transcripts more quickly at inference-time. Furthermore, we subsequently demonstrate how this approach can also improve the overall segmentation performance. Finally, we evaluate our proposed methods across the benchmark datasets to better understand the applicability of transformers and the importance of transcript selection on this video-driven weakly-supervised task.


title: Technical comments on the optimal control for linear distributed time-delay

abstract: The solution to the infinite horizon optimal control problem for linear distributed time-delay systems is presented. The proposal is based on the use of the Cauchy solution for distributed time-delay systems. In contrast with previous results (for punctual time delay systems), the form of the functional and its properties are formally justified. An important property is demonstrated: the Bellman functional admits upper and lower bounds, thus it is proved to be positive definite. Additionally, some experimental results on a temperature process are presented.


title: Bullshark: DAG BFT Protocols Made Practical

abstract: We present Bullshark, the first directed acyclic graph (DAG) based asynchronous Byzantine Atomic Broadcast protocol that is optimized for the common synchronous case. Like previous DAG-based BFT protocols, Bullshark requires no extra communication to achieve consensus on top of building the DAG. That is, parties can totally order the vertices of the DAG by interpreting their local view of the DAG edges. Unlike other asynchronous DAG-based protocols, Bullshark provides a practical low latency fast-path that exploits synchronous periods and deprecates the need for notoriously complex view-change mechanisms. Bullshark achieves this while maintaining all the desired properties of its predecessor DAG-Rider. Namely, it has optimal amortized communication complexity, it provides fairness and asynchronous liveness, and safety is guaranteed even under a quantum adversary. In order to show the practicality and simplicity of our approach, we also introduce a standalone partially synchronous version of Bullshark which we evaluate against the state of the art. The implemented protocol is embarrassingly simple (200 LOC on top of an existing DAG-based mempool implementation (Narwhal & Tusk). It is highly efficient, achieving for example, 125,000 transaction per second with a 2 seconds latency for a deployment of 50 parties. In the same setting the state of the art pays a steep 50% latency increase as it optimizes for asynchrony.


title: A circuit-level protocol and analysis for twist-based lattice surgery

abstract: Lattice surgery is a measurement-based technique for performing fault-tolerant quantum computation in two dimensions. When using the surface code, the most general lattice surgery operations require lattice irregularities called twist defects. However, implementing twist-based lattice surgery may require additional resources, such as extra device connectivity, and could lower the threshold and overall performance for the surface code. Here we provide an explicit twist-based lattice surgery protocol and its requisite connectivity layout. We also provide new stabilizer measurement circuits for measuring twist defects which are compatible with our chosen gate scheduling. We undertake the first circuit-level error correction simulations during twist-based lattice surgery using a biased depolarizing noise model. Our results indicate a slight decrease in the threshold for timelike logical failures compared to lattice surgery protocols with no twist defects in the bulk. However, comfortably below threshold (i.e. with CNOT infidelities below $5 \times 10^{-3}$), the performance degradation is mild and in fact preferable over proposed alternative twist-free schemes. Lastly, we provide an efficient scheme for measuring $Y$ operators along boundaries of surface codes which bypasses certain steps that were required in previous schemes.


title: Stability and instability results for sign-changing solutions to second-order critical elliptic equations

abstract: On a smooth, closed Riemannian manifold $\left(M,g\right)$ of dimension $n\ge3$, we consider the stationary Schr\"odinger equation $\Delta_gu+h_0u=\left|u\right|^{2^*-2}u$, where $\Delta_g:=-\text{div}_g\nabla$, $h_0\in C^1\left(M\right)$ and $2^* :=\frac{2n}{n-2}$. We prove that, up to perturbations of the potential function $h_0$ in $C^1\left(M\right)$, the sets of sign-changing solutions that are bounded in $H^1\left(M\right)$ are precompact in the $C^2$ topology. We obtain this result under the assumptions that $\left(M,g\right)$ is locally conformally flat, $n\ge7$ and $h_0\ne\frac{n-2}{4\left(n-1\right)}\text{Scal}_g$ at all points in $M$, where $\text{Scal}_g$ is the scalar curvature of the manifold. We then provide counterexamples in every dimension $n\ge3$ showing the optimality of these assumptions.


title: Quantum fluctuations and lineshape anomaly in a high-$\beta$ silver-coated InP-based metallic nanolaser

abstract: Metallic nanocavity lasers provide important technological advancement towards even smaller integrable light sources. They give access to widely unexplored lasing physics in which the distinction between different operational regimes, like those of thermal or a coherent light emission, becomes increasingly challenging upon approaching a device with a near-perfect spontaneous-emission coupling factor $\beta$. In fact, quantum-optical studies have to be employed to reveal a transition to coherent emission in the intensity fluctuation behavior of nanolasers when the input-output characteristic appears thresholdless for $\beta = 1$ nanolasers. Here, we identify a new indicator for lasing operation in high-$\beta$ lasers by showing that stimulated emission can give rise to a lineshape anomaly manifesting as a transition from a Lorentzian to a Gaussian component in the emission linewidth that dominates the spectrum above the lasing threshold.


title: On the equality of operator valued weights

abstract: G. K. Pedersen and M. Takesaki have proved in 1973 that if $\varphi$ is a faithful, semi-finite, normal weight on a von Neumann algebra $M\;\!$, and $\psi$ is a $\sigma^{\varphi}$-invariant, semi-finite, normal weight on $M\;\!$, equal to $\varphi$ on the positive part of a weak${}^*$-dense $\sigma^{\varphi}$-invariant $*$-subalgebra of $\mathfrak{M}_{\varphi}\;\!$, then $\psi =\varphi\;\!$. In 1978 L. Zsid\'o extended the above result by proving: if $\varphi$ is as above, $a\geq 0$ belongs to the centralizer $M^{\varphi}$ of $\varphi\;\!$, and $\psi$ is a $\sigma^{\varphi}$-invariant, semi-finite, normal weight on $M\;\!$, equal to $\varphi_a:=\varphi (a^{1/2}\;\!\cdot\;\! a^{1/2})$ on the positive part of a weak${}^*$-dense $\sigma^{\varphi}$-invariant $*$-subalgebra of $\mathfrak{M}_{\varphi}\;\!$, then $\psi =\varphi_a\;\!$. Here we will further extend this latter result, proving criteria for both the inequality $\psi \leq\varphi_a$ and the equality $\psi =\varphi_a\;\!$. Particular attention is accorded to criteria with no commutation assumption between $\varphi$ and $\psi\;\!$, in order to be used to prove inequality and equality criteria for operator valued weights. Concerning operator valued weights, it is proved that if $E_1\;\! ,E_2$ are semi-finite, normal operator valued weights from a von Neumann algebra $M$ to a von Neumann subalgebra $N\ni 1_M$ and they are equal on $\mathfrak{M}_{E_1}\;\!$, then $E_2\leq E_1\;\!$. Moreover, it is shown that this happens if and only if for any (or, if $E_1\;\! ,E_2$ have equal supports, for some) faithful, semi-finite, normal weight $\theta$ on $N$ the weights $\theta\circ E_2\;\! ,\theta\circ E_1$ coincide on $\mathfrak{M}_{\theta\circ E_1}\;\!$.


title: Modelling heat transfer in laser-soft matter interaction via chaotic Ikeda map

abstract: We develop a model for simulating the heat transfer phenomena within a biological soft material using the Ikeda chaotic map. Our approach is implemented by sampling the optical intensity via the Ikeda map to investigate the influence on the heat distribution over the tissue. Our method has many potential advantages including the possibility of investigating the nonlinear optical effects resulting from the intense beam-induced feedback mechanisms. This in turn, leads to the flexibility and dynamical controllability in comparison to the quasi-static Monte-Carlo method. The proposed approach is thus appropriate for the applications in the light beam-guided nanodrug injection and microsurgery.

categories: physics.med-ph nlin.CD physics.bio-ph physics.comp-ph physics.optics


title: Machine learning techniques to construct detailed phase diagrams for skyrmion systems

abstract: Recently, there has been an increased interest in the application of machine learning (ML) techniques to a variety of problems in condensed matter physics. In this regard, of particular significance is the characterization of simple and complex phases of matter. Here, we use a ML approach to construct the full phase diagram of a well known spin model combining ferromagnetic exchange and Dzyaloshinskii-Moriya (DM) interactions where topological phases emerge. At low temperatures, the system is tuned from a spiral phase to a skyrmion crystal by a magnetic field. However, thermal fluctuations induce two types of intermediate phases, bimerons and skyrmion gas, which are not as easily determined as spirals or skyrmion crystals. We resort to large scale Monte Carlo simulations to obtain low temperature spin configurations, and train a convolutional neural network (CNN), taking only snapshots at specific values of the DM couplings, to classify between the different phases, focusing on the intermediate and intricate topological textures. We then apply the CNN to higher temperature configurations and to other DM values, to construct a detailed magnetic field-temperature phase diagram, achieving outstanding results. We discuss the importance of including the disordered paramagnetic phases in order to get the phase boundaries, and finally, we compare our approach with other ML algorithms.


title: On the total energy conservation of the Alcubierre spacetime

abstract: In this article, we consider the Alcubierre spacetime, such a spacetime describes a ``bubble'' that propagates with arbitrary global velocity. This setting allows movement at a speed greater than that of light. There are some known problems with this metric, e.g., the source's negative energy and the violation of the source's energy conservation when the bubble accelerates. We address these two issues within the realm of the Teleparallel Equivalent of General Relativity (TEGR). The energy conservation problem can be solved when considering the energy of the gravitational field itself. The total energy of the spacetime, gravitational plus source, is conserved even in accelerated motion. We explicitly show the dependence of energy and gravitational energy flux on the frame of reference, one adapted to a static observer and the other to a free-falling one in the same coordinate system. Addressing the problem of energy negativity of the source, we find that a static observer measures positive energy of the source, while an Eulerian observer measures a negative one. Thus, we surmise that negative energy may be a reference problem.


title: Cavity mediated level attraction and repulsion between magnons

abstract: We characterize some of the distinctive hallmarks of magnon-magnon interaction mediated by the intracavity field of a microwave cavity, along with their testable ramifications. In general, we foreground two widely dissimilar parameter domains that bring forth the contrasting possibilities of level splitting and level crossing. The former is observed in the regime of strong magnon-photon couplings, particularly when the three modes bear comparable relaxation rates. This character is marked by the appearance of three distinguishable and non-converging polariton branches in the spectral response to a cavity drive. However, when the bare modes are resonant and the couplings perfectly symmetrical, one of the spectral peaks gets wiped out. This anomalous extinction of polaritonic response can be traced down to the existence of a conspicuous dark mode alongside two frequency-shifted bright modes. In an alternate parameter regime, where the magnon modes are weakly coupled to the cavity, features of level attraction unfold, subject to a large relaxation rate for the cavity mode. Concurrently, for antisymmetric detunings to the magnon modes, a transmission window springs into existence, exhibiting transparency in the limit of negligible dissipation from the magnons. The emergence of level attraction can be reconciled with a theoretical model that embodies the dynamics of the magnon-magnon subsystem when the cavity field decays rapidly into its steady state. In this limit, we identify a purely dissipative coupling between the magnon modes.


title: Decomposable sums and their implications on naturally quasiconvex risk measures

abstract: Convexity and quasiconvexity are two properties that capture the concept of diversification for risk measures. Between the two, there is natural quasiconvexity, an old but not so well-known property weaker than convexity but stronger than quasiconvexity. A detailed discussion on natural quasiconvexity is still missing and this paper aims to fill this gap in the setting of conditional risk measures. We relate natural quasiconvexity to additively decomposable sums. The notion of convexity index, defined in 1980s for finite-dimensional vector spaces, plays a crucial role in the discussion of decomposable sums. We propose a general treatment of convexity index in topological vector spaces and use it to study naturally quasiconvex risk measures. We prove that natural quasiconvexity and convexity are equivalent for conditional risk measures on $L^p$ spaces, $p \geq 1$, under mild continuity and locality conditions. Finally, we discuss an alternative notion of locality with respect to an orthonormal basis in $L^2$.


title: Point processes of exceedances for random walks in random sceneries

abstract: Let $\{\xi(k), k \in \mathbb{Z} \}$ be a stationary sequence of random variables and let $\{S_n, n \in \mathbb{N}_+ \}$ be a transient random walk in the domain of attraction of a stable law. In the previous work \cite{Nicolas_Ahmad}, under conditions of type $D(u_n)$ and $D'(u_n)$ we provided a limit theorem for the maximum of the first $n$ terms of the sequence $\{\xi(S_n), n \in \mathbb{N} \}$. In this paper, under the same conditions we will see that, the limit of the process which counts the numbers of the exceedances of the form $\{\xi(S_k)>u_n\}, k\geq 1$, is a compound Poisson point process. We also deal with the so-called extremal index for the sequence $\{\xi(S_n), n \in \mathbb{N} \}$ and we discuss some weak mixing properties.


title: Common Fixed Point Theorems for Self Mappings on a Complete Vector S-metric Space

abstract: S-metric space was introduced by Sedghi et al. in 2012. We derive some common fixed point results for self-mappings on vector valued complete S-metric space. In support of our results, we also give some examples.


title: New fixed point theorems for $(\phi, F)-$contraction on rectangular b-metric spaces

abstract: The Banach contraction principle is the most celebrated fixed point theorem, it has been generalized in various directions. In this paper, inspired by the concept of $(\phi, F)-$contraction in metric spaces, introduced by Wardowski. We present the notion of $(\phi, F)-$contraction in $b-$rectangular metric spaces to study the existence and uniqueness of fixed point for the mappings in this spaces. Our results improve many existing results.


title: A short proof of Ledoit-P\'ech\'e's RIE formula for covariance matrices

abstract: This is a short proof of Ledoit-P\'ech\'e's RIE formula for covariance matrices. The proof is based on the Stein formula, which gives a very simple way to derive the result. One of the advantages of this approach is that it shows that the only really needed hypothesis, for the machinery to work, is that the mean of the eigenvalues of the true covariance matrix and the largest of them have the same order.


title: Fixed point theorems in controlled rectangular metric spaces

abstract: In this paper, we introduce an extension of rectangular metric spaces called controlled rectangular metric spaces, by changing the rectangular inequality as follows: \begin{equation*} d(x, y)\leq\alpha(x, u)d(x, u)+\alpha(u, v)d(u, v)+\alpha(v, y)d(v, y), \end{equation*} for all distinct $x, y, u, v\in X$ with the function $\alpha: X\times X\rightarrow[1,\infty[$. We also establish some fixed point theorems for self-mappings defined on such spaces. Our main results extends and improves many results existing in the literature. Moreover, an illustrative example is presented to support the obtained results.


title: Model Stability with Continuous Data Updates

abstract: In this paper, we study the "stability" of machine learning (ML) models within the context of larger, complex NLP systems with continuous training data updates. For this study, we propose a methodology for the assessment of model stability (which we refer to as jitter under various experimental conditions. We find that model design choices, including network architecture and input representation, have a critical impact on stability through experiments on four text classification tasks and two sequence labeling tasks. In classification tasks, non-RNN-based models are observed to be more stable than RNN-based ones, while the encoder-decoder model is less stable in sequence labeling tasks. Moreover, input representations based on pre-trained fastText embeddings contribute to more stability than other choices. We also show that two learning strategies -- ensemble models and incremental training -- have a significant influence on stability. We recommend ML model designers account for trade-offs in accuracy and jitter when making modeling choices.


title: Spectral decimation of piecewise centrosymmetric Jacobi operators on graphs

abstract: We study the spectral theory of a class of piecewise centrosymmetric Jacobi operators defined on an associated family of substitution graphs. Given a finite centrosymmetric matrix viewed as a weight matrix on a finite directed path graph and a probabilistic Laplacian viewed as a weight matrix on a locally finite strongly connected graph, we construct a new graph and a new operator by edge substitution. Our main result proves that the spectral theory of the piecewise centrosymmetric Jacobi operator can be explicitly related to the spectral theory of the probabilistic Laplacian using certain orthogonal polynomials. Our main tools involve the so-called spectral decimation, known from the analysis on fractals, and the classical Schur complement. We include several examples of self-similar Jacobi matrices that fit into our framework.


title: Density of smooth functions in Musielak-Orlicz spaces

abstract: We provide necessary and sufficient conditions for the space of smooth functions with compact supports $C^\infty_C(\Omega)$ to be dense in Musielak-Orlicz spaces $L^\Phi(\Omega)$ where $\Omega$ is an open subset of $\mathbb{R}^d$. In particular we prove that if $\Phi$ satisfies condition $\Delta_2$, the closure of $C^\infty_C(\Omega)\cap L^\Phi(\Omega)$ is equal to $L^\Phi(\Omega)$ if and only if the measure of singular points of $\Phi$ is equal to zero. This extends the earlier density theorems proved under the assumption of local integrability of $\Phi$, which implies that the measure of the singular points of $\Phi$ is zero. As a corollary we obtain analogous results for Musielak-Orlicz spaces generated by double phase functional and we recover the well known result for variable exponent Lebesgue spaces.


title: Volume growth and on-diagonal heat kernel bounds on Riemannian manifolds with an end

abstract: We investigate heat kernel estimates of the form $p_{t}(x, x)\geq c_{x}t^{-\alpha},$ for large enough $t,$ where $\alpha$ and $c_{x}$ are positive reals and $c_{x}$ may depend on $x,$ on manifolds having at least one end.


title: $\Upsilon$ and $\eta_b$ nuclear bound states

abstract: $\Upsilon$ and $\eta_b$ nuclear bound state energies are calculated for various nuclei neglecting any possible effects of the widths. Essential input for the calculations, namely the medium-modified $B$ and $B^{*}$ meson masses, as well as the density distributions in nuclei, are calculated within the quark-meson coupling (QMC) model. The attractive potentials for the $\Upsilon$ and $\eta_b$ mesons in nuclei are calculated from the mass shifts of these mesons in nuclear matter in the local density approximation. These potentials originate from the in-medium enhanced $B\overline{B}$ and $BB^{*}$ loops in their respective self energy. After an extensive analysis we conclude that our results suggest that the $\Upsilon$ and $\eta_b$ mesons should form bound states with all the nuclei considered.


title: An efficient aggregation method for the symbolic representation of temporal data

abstract: Symbolic representations are a useful tool for the dimension reduction of temporal data, allowing for the efficient storage of and information retrieval from time series. They can also enhance the training of machine learning algorithms on time series data through noise reduction and reduced sensitivity to hyperparameters. The adaptive Brownian bridge-based aggregation (ABBA) method is one such effective and robust symbolic representation, demonstrated to accurately capture important trends and shapes in time series. However, in its current form the method struggles to process very large time series. Here we present a new variant of the ABBA method, called fABBA. This variant utilizes a new aggregation approach tailored to the piecewise representation of time series. By replacing the k-means clustering used in ABBA with a sorting-based aggregation technique, and thereby avoiding repeated sum-of-squares error computations, the computational complexity is significantly reduced. In contrast to the original method, the new approach does not require the number of time series symbols to be specified in advance. Through extensive tests we demonstrate that the new method significantly outperforms ABBA with a considerable reduction in runtime while also outperforming the popular SAX and 1d-SAX representations in terms of reconstruction accuracy. We further demonstrate that fABBA can compress other data types such as images.


title: Overview of contemporary systems driven by open-design movement

abstract: The movement for open-design focuses on the creation of machines, physical systems, and products using design information shared publicly. It consists of the development of systems incorporating open-source hardware and software which can be easily/freely customized and implemented. Generally, this movement is adopted through the Internet and usually executed without economic recompense. The aim and idea of this movement is similar to the open-source movement, however is employed for designing & developing physical systems instead of software system alone. This design necessitates co-creating the end product, which is expected to be designed by the users, in place of an outdoor investor for example a private business. In tune with this, the comprehensive review is carried out wherein a variety of contemporary systems driven by open-design movement for diverse applications is discussed.


title: Transport and optical properties of the chiral semiconductor Ag3AuSe2

abstract: Previous band structure calculations predicted Ag3AuSe2 to be a semiconductor with a band gap of approximately 1 eV. Here, we report single crystal growth of Ag3AuSe2 and its transport and optical properties. Single crystals of Ag3AuSe2 were synthesized by slow-cooling from the melt, and grain sizes were confirmed to be greater than 2 mm using electron backscatter diffraction. Optical and transport measurements reveal that Ag3AuSe2 is a highly resistive semiconductor with a band gap of and activation energy around 0.3 eV. Our first-principles calculations show that the experimentally-determined band gap lies between the predicted band gaps from GGA and hybrid functionals. We predict band inversion to be possible by applying tensile strain. The sensitivity of the gap to Ag/Au ordering, chemical substitution, and heat treatment merit further investigation.


title: Cost-Effective Training in Low-Resource Neural Machine Translation

abstract: While Active Learning (AL) techniques are explored in Neural Machine Translation (NMT), only a few works focus on tackling low annotation budgets where a limited number of sentences can get translated. Such situations are especially challenging and can occur for endangered languages with few human annotators or having cost constraints to label large amounts of data. Although AL is shown to be helpful with large budgets, it is not enough to build high-quality translation systems in these low-resource conditions. In this work, we propose a cost-effective training procedure to increase the performance of NMT models utilizing a small number of annotated sentences and dictionary entries. Our method leverages monolingual data with self-supervised objectives and a small-scale, inexpensive dictionary for additional supervision to initialize the NMT model before applying AL. We show that improving the model using a combination of these knowledge sources is essential to exploit AL strategies and increase gains in low-resource conditions. We also present a novel AL strategy inspired by domain adaptation for NMT and show that it is effective for low budgets. We propose a new hybrid data-driven approach, which samples sentences that are diverse from the labelled data and also most similar to unlabelled data. Finally, we show that initializing the NMT model and further using our AL strategy can achieve gains of up to $13$ BLEU compared to conventional AL methods.


title: Diffusion Tensor Estimation with Transformer Neural Networks

abstract: Diffusion tensor imaging (DTI) is a widely used method for studying brain white matter development and degeneration. However, standard DTI estimation methods depend on a large number of high-quality measurements. This would require long scan times and can be particularly difficult to achieve with certain patient populations such as neonates. Here, we propose a method that can accurately estimate the diffusion tensor from only six diffusion-weighted measurements. Our method achieves this by learning to exploit the relationships between the diffusion signals and tensors in neighboring voxels. Our model is based on transformer networks, which represent the state of the art in modeling the relationship between signals in a sequence. In particular, our model consists of two such networks. The first network estimates the diffusion tensor based on the diffusion signals in a neighborhood of voxels. The second network provides more accurate tensor estimations by learning the relationships between the diffusion signals as well as the tensors estimated by the first network in neighboring voxels. Our experiments with three datasets show that our proposed method achieves highly accurate estimations of the diffusion tensor and is significantly superior to three competing methods. Estimations produced by our method with six diffusion-weighted measurements are comparable with those of standard estimation methods with 30-88 diffusion-weighted measurements. Hence, our method promises shorter scan times and more reliable assessment of brain white matter, particularly in non-cooperative patients such as neonates and infants.


title: Port Selection for Fluid Antenna Systems

abstract: Fluid antenna system promises to obtain enormous diversity in the small space of a mobile device by switching the position of the radiating element to the most desirable position from a large number of prescribed locations of the given space. Previous researches have revealed the promising performance of fluid antenna systems if the position with the maximum received signal-to-noise ratio (SNR) is chosen. However, selecting the best position, referred to as port selection, requires a huge number of SNR observations from the ports and may prove to be infeasible. This letter tackles this problem by devising a number of fast port selection algorithms utilizing a combination of machine learning methods and analytical approximation when the system observes only a few ports. Simulation results illustrate that with only 10% of the ports observed, more than an order of magnitude reduction in the outage probability can be achieved. Even in the extreme cases where only one port is observed, considerable performance improvements are possible using the proposed algorithms.


title: Spinning Driven Dynamic Nuclear Polarization with Optical Pumping

abstract: We propose a new, more efficient, and potentially cost effective, solid-state nuclear spin hyperpolarization method combining the Cross Effect mechanism and electron spin optical hyperpolarization in rotating solids. We first demonstrate optical hyperpolarization in the solid state at low temperature and low field, and then investigate its field dependence to obtain the optimal condition for high-field electron spin hyperpolarization. The results are then incorporated into advanced Magic Angle Spinning Dynamic Nuclear Polarization (MAS-DNP) numerical simulations that show that optically pumped MAS-DNP could yield breakthrough enhancements at very high magnetic fields. Based on these investigations, enhancements greater than the ratio of electron to nucleus magnetic moments (>658 for 1H) are possible without microwave irradiation. This could solve at once the MAS-DNP performance decrease with increasing field and the high cost of MAS-DNP instruments at very high fields.


title: Erd\H{o}s' minimum overlap problem

abstract: We obtain a substantially improved lower bound for the minimum overlap problem asked by Erd\H{o}s. Our approach uses elementary Fourier analysis to translate the problem to a convex optimization program.


title: Cosmic ray muon clustering for the MicroBooNE liquid argon time projection chamber using sMask-RCNN

abstract: In this article, we describe a modified implementation of Mask Region-based Convolutional Neural Networks (Mask-RCNN) for cosmic ray muon clustering in a liquid argon TPC and applied to MicroBooNE neutrino data. Our implementation of this network, called sMask-RCNN, uses sparse submanifold convolutions to increase processing speed on sparse datasets, and is compared to the original dense version in several metrics. The networks are trained to use wire readout images from the MicroBooNE liquid argon time projection chamber as input and produce individually labeled particle interactions within the image. These outputs are identified as either cosmic ray muon or electron neutrino interactions. We find that sMask-RCNN has an average pixel clustering efficiency of 85.9% compared to the dense network's average pixel clustering efficiency of 89.1%. We demonstrate the ability of sMask-RCNN used in conjunction with MicroBooNE's state-of-the-art Wire-Cell cosmic tagger to veto events containing only cosmic ray muons. The addition of sMask-RCNN to the Wire-Cell cosmic tagger removes 70% of the remaining cosmic ray muon background events at the same electron neutrino event signal efficiency. This event veto can provide 99.7% rejection of cosmic ray-only background events while maintaining an electron neutrino event-level signal efficiency of 80.1%. In addition to cosmic ray muon identification, sMask-RCNN could be used to extract features and identify different particle interaction types in other 3D-tracking detectors.


title: Perspective Transformation Layer

abstract: Incorporating geometric transformations that reflect the relative position changes between an observer and an object into computer vision and deep learning models has attracted much attention in recent years. However, the existing proposals mainly focus on the affine transformation that is insufficient to reflect such geometric position changes. Furthermore, current solutions often apply a neural network module to learn a single transformation matrix, which not only ignores the importance of multi-view analysis but also includes extra training parameters from the module apart from the transformation matrix parameters that increase the model complexity. In this paper, a perspective transformation layer is proposed in the context of deep learning. The proposed layer can learn homography, therefore reflecting the geometric positions between observers and objects. In addition, by directly training its transformation matrices, a single proposed layer can learn an adjustable number of multiple viewpoints without considering module parameters. The experiments and evaluations confirm the superiority of the proposed layer.


title: Efficient Generation of Membrane and Solvent Tetrahedral Meshes for Ion Channel Finite Element Calculation

abstract: A finite element solution of an ion channel dielectric continuum model such as Poisson-Boltzmann equation (PBE) and a system of Poisson-Nernst-Planck equations (PNP) requires tetrahedral meshes for an ion channel protein region, a membrane region, and an ionic solvent region as well as an interface fitted irregular tetrahedral mesh of a simulation box domain. However, generating these meshes is very difficult and highly technical due to the related three regions having very complex geometrical shapes. Currently, an ion channel mesh generation software package developed in Lu's research group is one available in the public domain. To significantly improve its mesh quality and computer performance, in this paper, new numerical schemes for generating membrane and solvent meshes are presented and implemented in Python, resulting in a new ion channel mesh generation software package. Numerical results are then reported to demonstrate the efficiency of the new numerical schemes and the quality of meshes generated by the new package for ion channel proteins with ion channel pores having different geometric complexities.


title: On unipotent radicals of motivic Galois groups

abstract: Let $\mathbf{T}$ be a neutral Tannakian category over a field of characteristic zero with unit object $\mathbf{1}$, and equipped with a filtration $W_\cdot$ similar to the weight filtration on mixed motives. Let $M$ be an object of $\mathbf{T}$, and $\underline{\mathfrak{u}}(M)\subset W_{-1}\underline{Hom}(M,M)$ the Lie algebra of the kernel of the natural surjection from the fundamental group of $M$ to the fundamental group of $Gr^WM$. A result of Deligne gives a characterization of $\underline{\mathfrak{u}}(M)$ in terms of the extensions $0\longrightarrow W_pM \longrightarrow M \longrightarrow M/W_pM \longrightarrow 0$: it states that $\underline{\mathfrak{u}}(M)$ is the smallest subobject of $W_{-1}\underline{Hom}(M,M)$ such that the sum of the aforementioned extensions, considered as extensions of $\mathbf{1}$ by $W_{-1}\underline{Hom}(M,M)$, is the pushforward of an extension of $\mathbf{1}$ by $\underline{\mathfrak{u}}(M)$. In this article, we study each of the above-mentioned extensions individually in relation to $\underline{\mathfrak{u}}(M)$. Among other things, we obtain a refinement of Deligne's result, where we give a sufficient condition for when an individual extension $0\longrightarrow W_pM \longrightarrow M \longrightarrow M/W_pM \longrightarrow 0$ is the pushforward of an extension of $\mathbf{1}$ by $\underline{\mathfrak{u}}(M)$. In the second half of the paper, we give an application to mixed motives whose unipotent radical of the motivic Galois group is as large as possible (i.e. with $\underline{\mathfrak{u}}(M)= W_{-1}\underline{Hom}(M,M)$). Using Grothedieck's formalism of \textit{extensions panach\'{e}es} we prove a classification result for such motives. Specializing to the category of mixed Tate motives we obtain a classification result for 3-dimensional mixed Tate motives over $\mathbb{Q}$ with three weights and large unipotent radicals.


title: How easy is it for investment managers to deploy their talent in green and brown stocks?

abstract: We explore the realized alpha-performance heterogeneity in green and brown stocks' universes using the peer performance ratios of Ardia and Boudt (2018). Focusing on S&P 500 index firms over 2014-2020 and defining peer groups in terms of firms' greenhouse gas emission levels, we find that, on average, about 20% of the stocks differentiate themselves from their peers in terms of future performance. We see a much higher time-variation in this opportunity set within brown stocks. Furthermore, the performance heterogeneity has decreased over time, especially for green stocks, implying that it is now more difficult for investment managers to deploy their skills when choosing among low-GHG intensity stocks.


title: Specifying and Reasoning about CPS through the Lens of the NIST CPS Framework

abstract: This paper introduces a formal definition of a Cyber-Physical System (CPS) in the spirit of the CPS Framework proposed by the National Institute of Standards and Technology (NIST). It shows that using this definition, various problems related to concerns in a CPS can be precisely formalized and implemented using Answer Set Programming (ASP). These include problems related to the dependency or conflicts between concerns, how to mitigate an issue, and what the most suitable mitigation strategy for a given issue would be. It then shows how ASP can be used to develop an implementation that addresses the aforementioned problems. The paper concludes with a discussion of the potentials of the proposed methodologies.


title: Hyperuniform Jammed Sphere Packings Have Anomalous Material Properties

abstract: A spatial distribution is hyperuniform if it has local density fluctuations that vanish in the limit of long length scales. Hyperuniformity is a well known property of both crystals and quasicrystals. Of recent interest, however, is disordered hyperuniformity: the presence of hyperuniform scaling without long-range configurational order. Jammed granular packings have been proposed as an example of disordered hyperuniformity, but recent numerical investigation has revealed that many jammed systems instead exhibit a complex set of distinct behaviors at long, emergent length scales. We use the Voronoi tesselation as a tool to define a set of rescaling transformations that can impose hyperuniformity on an arbitrary weighted point process, and show that these transformations can be used in simulations to iteratively generate hyperuniform, mechanically stable packings of athermal soft spheres. These hyperuniform jammed packings display atypical mechanical properties, particularly in the low-frequency phononic excitations, which exhibit an isolated band of highly collective modes and a band-gap around zero frequency.


title: Expectile-based hydrological modelling for uncertainty estimation: Life after mean

abstract: Predictions of hydrological models should be probabilistic in nature. Our aim is to introduce a method that estimates directly the uncertainty of hydrological simulations using expectiles, thus complementing previous quantile-based direct approaches as well as generalizing mean-based approaches. Expectiles are new risk measures in hydrology. Compared to quantiles that use information of the frequency of process realizations over a specified value, expectiles use additional information of the magnitude of the exceedances over the specified value. Expectiles are least square analogues of quantiles and can characterize the probability distribution in much the same way as quantiles do. Moreover, the mean of the probability distribution is the special case of the expectile at level 0.5. To this end, we propose calibrating hydrological models using the expectile loss function, which is strictly consistent for expectiles. We apply our method to 511 basins in contiguous US and deliver predictive expectiles of hydrological simulations with the GR4J, GR5J and GR6J hydrological models at expectile levels 0.5, 0.9, 0.95 and 0.975. An honest assessment empirically proves that the GR6J model outperforms the other two models at all expectile levels. Great opportunities are offered for moving beyond the mean in hydrological modelling by simply adjusting the objective function.


title: The unipotent radical of the Mumford-Tate group of a very general mixed Hodge structure with a fixed associated graded

abstract: The family of all mixed Hodge structures on a given rational vector space $M_\mathbb{Q}$ with a fixed weight filtration $W_\cdot$ and a fixed associated graded Hodge structure $Gr^WM$ is naturally in a one to one correspondence with a complex affine space. We study the unipotent radical of the very general Mumford-Tate group of the family. We do this by using general Tannakian results which relate the unipotent radical of the fundamental group of an object in a filtered Tannakian category to the extension classes of the object coming from the filtration. Our main result shows that if $Gr^WM$ is polarizable and satisfies some conditions, then outside a union of countably many proper Zariski closed subsets of the parametrizing affine space, the unipotent radical of the Mumford-Tate group of the objects in the family is equal to the unipotent radical of the parabolic subgroup of $GL(M_\mathbb{Q})$ associated to the weight filtration on $M_\mathbb{Q}$ (in other words, outside a union of countably many proper Zariski closed sets the unipotent radical of the Mumford-Tate group is as large as one may hope for it to be). Note that here $Gr^WM$ itself may have a small Mumford-Tate group.


title: Collisional fragmentation and bulk composition tracking in REBOUND

abstract: We present a fragmentation module and a composition tracking code for the $n$-body code REBOUND. Our fragmentation code utilises previous semi-analytic models and follows an implementation method similar to fragmentation for the $n$-body code MERCURY. In our $n$-body simulations with fragmentation, we decrease the collision and planet formation timescales by inflating the particle radii by an expansion factor $f$ and experiment with various values of $f$ to understand how expansion factors affect the collision history and final planetary system. As the expansion factor increases, so do the rate of mergers which produces planetary systems with more planets and planets at larger orbits. Additionally, we present a composition tracking code which follows the compositional change of homogeneous bodies as a function of mass exchange and use it to study how fragmentation and the use of an expansion factor affects volatile delivery to the inner terrestrial disc. We find that fragmentation enhances radial mixing relative to perfect merging and that on average, as $f$ increases so does the average water mass fraction of the planets. Radial mixing decreases with increasing $f$ as collisions happen early on, before the bodies have time to grow to excited orbits and move away from their original location


title: Taylor-Lagrange Neural Ordinary Differential Equations: Toward Fast Training and Evaluation of Neural ODEs

abstract: Neural ordinary differential equations (NODEs) -- parametrizations of differential equations using neural networks -- have shown tremendous promise in learning models of unknown continuous-time dynamical systems from data. However, every forward evaluation of a NODE requires numerical integration of the neural network used to capture the system dynamics, making their training prohibitively expensive. Existing works rely on off-the-shelf adaptive step-size numerical integration schemes, which often require an excessive number of evaluations of the underlying dynamics network to obtain sufficient accuracy for training. By contrast, we accelerate the evaluation and the training of NODEs by proposing a data-driven approach to their numerical integration. The proposed Taylor-Lagrange NODEs (TL-NODEs) use a fixed-order Taylor expansion for numerical integration, while also learning to estimate the expansion's approximation error. As a result, the proposed approach achieves the same accuracy as adaptive step-size schemes while employing only low-order Taylor expansions, thus greatly reducing the computational cost necessary to integrate the NODE. A suite of numerical experiments, including modeling dynamical systems, image classification, and density estimation, demonstrate that TL-NODEs can be trained more than an order of magnitude faster than state-of-the-art approaches, without any loss in performance.


title: Mechanizing Matching Logic In Coq

abstract: Matching logic is a formalism for specifying, and reasoning about, mathematical structures, using patterns and pattern matching. Growing in popularity, it has been used to define many logical systems such as separation logic with recursive definitions and linear temporal logic. In addition, it serves as the logical foundation of the K semantic framework, which was used to build practical verifiers for a number of real-world languages. Despite being a fundamental formal system accommodating substantial theories, matching logic lacks a general-purpose, machine-checked formalization. Hence, we formalize matching logic using the Coq proof assistant. Specifically, we create a new representation of matching logic that uses a locally nameless encoding, and we formalize the syntax, semantics, and proof system of this representation in the Coq proof assistant. Crucially, we prove the soundness of the formalized proof system and provide a means to carry out interactive matching logic reasoning in Coq. We believe this work provides a previously unexplored avenue for reasoning about matching logic, its models, and the proof system.


title: Hyperbolic Metamaterial Filter for Angle-independent TM-Transmission in Imaging Applications

abstract: With conventional narrowband filters, the center-wavelength of the narrow transmission band undergoes large shifts as the angle of incident light changes. In this project, we designed and experimentally verified a type of hyperbolic metamaterial Bragg stack that eliminates, or vastly reduces, this angle-of-incidence dependence (i.e., dispersion) of the transmission band for TM polarized beam. The filter developed in this project is composed of array of subwavelength sized metal wires vertically penetrating in the dielectric layers of the Bragg stack. We first discuss the physical reasons why such a structure is expected to minimize dispersion, then we performed detailed electromagnetic modeling, fabrication of proof-of-concept structures, and optical testing of the structures. The filter is fabricated by CMOS fabrication techniques and optical characterized using Fourier-transform infrared spectroscopy. Both simulated and experimental data show that narrow band transmission filters can be designed such that the center-wavelength of the transmission peak for TM polarized incident light does not change as the angle of incidence of an incoming beam changes. These types of narrowband notch filters have been used in many sensing and imaging applications, including remote sensing and hyperspectral imaging.


title: Parameter-free Online Test-time Adaptation

abstract: Training state-of-the-art vision models has become prohibitively expensive for researchers and practitioners. For the sake of accessibility and resource reuse, it is important to focus on adapting these models to a variety of downstream scenarios. An interesting and practical paradigm is online test-time adaptation, according to which training data is inaccessible, no labelled data from the test distribution is available, and adaptation can only happen at test time and on a handful of samples. In this paper, we investigate how test-time adaptation methods fare for a number of pre-trained models on a variety of real-world scenarios, significantly extending the way they have been originally evaluated. We show that they perform well only in narrowly-defined experimental setups and sometimes fail catastrophically when their hyperparameters are not selected for the same scenario in which they are being tested. Motivated by the inherent uncertainty around the conditions that will ultimately be encountered at test time, we propose a particularly "conservative" approach, which addresses the problem with a Laplacian Adjusted Maximum-likelihood Estimation (LAME) objective. By adapting the model's output (not its parameters), and solving our objective with an efficient concave-convex procedure, our approach exhibits a much higher average accuracy across scenarios than existing methods, while being notably faster and have a much lower memory footprint. The code is available at https://github.com/fiveai/LAME.


title: Light Quarks at Large $N$

abstract: Lattice gauge theory simulations are our principal probe of the masses of the light quarks. Results from such computations are the primary evidence against the $m_u=0$ solution to the strong CP problem. The large-$N$ approximation offers an independent approach to light quarks. We extend existing literature, noting that one can determine the parameters of the non-linear sigma model through second order in quark mass, rule out the $m_u=0$ hypothesis, and make predictions for outputs of lattice calculations and phenomenological fits. A crucial feature of this analysis is a Wilsonian effective action at scales above the $\eta^\prime$ mass. One can self-consistently test the validity of aspects of this framework, and it may well be good to the part-in-three level. We also note consistency with some phenomenological fits and existing lattice results.


title: Deep Reinforcement Learning for Shared Autonomous Vehicles (SAV) Fleet Management

abstract: Shared Automated Vehicles (SAVs) Fleets companies are starting pilot projects nationwide. In 2020 in Fairfax Virginia it was announced the first Shared Autonomous Vehicle Fleet pilot project in Virginia. SAVs promise to improve quality of life. However, SAVs will also induce some negative externalities by generating excessive vehicle miles traveled (VMT), which leads to more congestions, energy consumption, and emissions. The excessive VMT are primarily generated via empty relocation process. Reinforcement Learning based algorithms are being researched as a possible solution to solve some of these problems: most notably minimizing waiting time for riders. But no research using Reinforcement Learning has been made about reducing parking space cost nor reducing empty cruising time. This study explores different \textbf{Reinforcement Learning approaches and then decide the best approach to help minimize the rider waiting time, parking cost, and empty travel


title: Extracting Space Situational Awareness Events from News Text

abstract: Space situational awareness typically makes use of physical measurements from radar, telescopes, and other assets to monitor satellites and other spacecraft for operational, navigational, and defense purposes. In this work we explore using textual input for the space situational awareness task. We construct a corpus of 48.5k news articles spanning all known active satellites between 2009 and 2020. Using a dependency-rule-based extraction system designed to target three high-impact events -- spacecraft launches, failures, and decommissionings, we identify 1,787 space-event sentences that are then annotated by humans with 15.9k labels for event slots. We empirically demonstrate a state-of-the-art neural extraction system achieves an overall F1 between 53 and 91 per slot for event extraction in this low-resource, high-impact domain.


title: Global stability of SIR model with heterogeneous transmission rate modeled by the Preisach operator

abstract: In recent years, classical epidemic models, which assume stationary behavior of individuals, have been extended to include an adaptive heterogeneous response of the population to the current state of the epidemic. However, it is widely accepted that human behavior can exhibit history-dependence as a consequence of learned experiences. This history-dependence is similar to hysteresis effects that have been well-studied in control theory. To illustrate the importance of history-dependence for epidemic theory, we study dynamics of a variant of the SIRS model where individuals exhibit lazy-switch responses to prevalence dynamics. The resulting model, which includes the Preisach hysteresis operator, possesses a continuum of endemic equilibrium states characterized by different proportions of susceptible, infected and recovered populations. We discuss stability properties of the endemic equilibrium set and relate them to the degree of heterogeneity of the adaptive response. Our results support the argument that public health responses during the emergence of a new disease can have long-term consequences for subsequent management efforts. The main mathematical contribution of this work is a method of global stability analysis, which uses a family of Lyapunov functions corresponding to different branches of the hysteresis operator.


title: Learning Temporally and Semantically Consistent Unpaired Video-to-video Translation Through Pseudo-Supervision From Synthetic Optical Flow

abstract: Unpaired video-to-video translation aims to translate videos between a source and a target domain without the need of paired training data, making it more feasible for real applications. Unfortunately, the translated videos generally suffer from temporal and semantic inconsistency. To address this, many existing works adopt spatiotemporal consistency constraints incorporating temporal information based on motion estimation. However, the inaccuracies in the estimation of motion deteriorate the quality of the guidance towards spatiotemporal consistency, which leads to unstable translation. In this work, we propose a novel paradigm that regularizes the spatiotemporal consistency by synthesizing motions in input videos with the generated optical flow instead of estimating them. Therefore, the synthetic motion can be applied in the regularization paradigm to keep motions consistent across domains without the risk of errors in motion estimation. Thereafter, we utilize our unsupervised recycle and unsupervised spatial loss, guided by the pseudo-supervision provided by the synthetic optical flow, to accurately enforce spatiotemporal consistency in both domains. Experiments show that our method is versatile in various scenarios and achieves state-of-the-art performance in generating temporally and semantically consistent videos. Code is available at: https://github.com/wangkaihong/Unsup_Recycle_GAN/.


title: StemP: A fast and deterministic Stem-graph approach for RNA and protein folding prediction

abstract: We propose a new deterministic methodology to predict RNA sequence and protein folding. Is stem enough for structure prediction? The main idea is to consider all possible stem formation in the given sequence. With the stem loop energy and the strength of stem, we explore how to deterministically utilize stem information for RNA sequence and protein folding structure prediction. We use graph notation, where all possible stems are represented as vertices, and co-existence as edges. This full Stem-graph presents all possible folding structure, and we pick sub-graph(s) which give the best matching energy for folding structure prediction. We introduce a Stem-Loop score to add structure information and to speed up the computation. The proposed method can handle secondary structure prediction as well as protein folding with pseudo knots. Numerical experiments are done using a laptop and results take only a few minutes or seconds. One of the strengths of this approach is in the simplicity and flexibility of the algorithm, and it gives deterministic answer. We explore protein sequences from Protein Data Bank, rRNA 5S sequences, and tRNA sequences from the Gutell Lab. Various experiments and comparisons are included to validate the propose method.


title: Clog mitigation in a microfluidic array via pulsatile flows

abstract: Clogging is a common obstacle encountered during the transport of suspensions and represents a significant energy and material cost across applications, including water purification, irrigation, biopharmaceutical processing, and aquifer recharge. Pulsatile pressure-driven flows can help mitigate clogging when compared to steady flows. Here, we study experimentally the influence of the amplitude of pulsation $0.25\,P_0 \leq \delta P \leq 1.25\,P_0$, where $P_0$ is the mean pressure, and of the frequency of pulsation $10^{-3}\,{\rm Hz} \leq f \leq 10^{-1}\,{\rm Hz}$ on clog mitigation in a microfluidic array of parallel channels using a dilute suspension of colloidal particles. The array geometry is representative of a classical filter, with parallel pores that clog over time, yielding a filter cake that continues to grow and can interact with other pores. We combine flow rate measurements with direct visualizations at the pore scale to correlate the observed clogging dynamics with the changes in flow rate. We observe that all pulsatile amplitudes at $0.1$ Hz yield increased throughput compared to steady flows. The rearrangement of particles when subject to a dynamic shear environment can delay the clogging of a pore or even remove an existing clog. However, this benefit is drastically reduced at $10^{-2}$ Hz and disappears at $10^{-3}$ Hz as the pulsatile timescale becomes too large compared to the timescale associated with the clogging and the growth of the filter cakes in this system. The present study demonstrates that pulsatile flows are a promising method to delay clogging at both the pore and system scale.


title: Categories of quantum liquids III

abstract: We continue our study of the categories of quantum liquids started in a previous work. We combine local quantum symmetries with topological skeletons into a single mathematical theory of topological nets and defect nets. In particular, we introduce the notion of a topological net, which is motivated from and generalizes that of a conformal net, and the notion of a defect net which generalizes that of a defect between conformal nets. We give explicit examples of them. Moreover, we construct the category of topological $n$-nets with $k$-morphisms defined by defect $n$-nets of codimension $k$, and show that the category of $n$D quantum liquids can be extracted from it and computed explicitly via the condensation theory of topological nets.

categories: hep-th cond-mat.str-el math-ph math.MP math.OA


title: IBAC: An Intelligent Dynamic Bandwidth Channel Access Avoiding Outside Warning Range Problem

abstract: IEEE 802.11ax uses the concept of primary and secondary channels, leading to the Dynamic Bandwidth Channel Access (DBCA) mechanism. By applying DBCA, a wireless station can select a wider channel bandwidth, such as 40/80/160 MHz, by applying the channel bonding feature. However, during channel bonding, inappropriate bandwidth selection can cause collisions. Therefore, to avoid collisions, a well-developed media access control (MAC) protocol is crucial to effectively utilize the channel bonding mechanism. In this paper, we address a collision scenario, called Outside Warning Range Problem (OWRP), that may occur during DBCA when a wireless station interferes with another wireless station after channel bonding is performed. Therefore, we propose a MAC layer mechanism, Intelligent Bonding Avoiding Collision (IBAC), that adapts the channel bonding level in DBCA in order to avoid the OWRP. We first design a theoretical model based on Markov chains for DBCA while avoiding the OWRP. Based on this model, we design a Thompson sampling based Bayesian approach to select the best possible channel bonding level intelligently. We analyze the performance of the IBAC through simulations where it is observed that, comparing to other competing mechanisms, the proposed approach can enhance the network performance significantly while avoiding the OWRP.


title: $b$-hadron spectroscopy study based on the similarity of double bottom baryon and bottom meson

abstract: The dynamical similarity which exists between the $\lambda$-mode excited $bbq$ baryons ($q$ refers to the $u$, $d$, and $s$ quarks) and the $\bar{b}q$ mesons inspires us to carry out a combined study of their spectroscopy. In this work, the masses and strong decays of these low-lying $b\bar{q}$ and $bbq$ states are studied by the same theoretical methods, and the dynamical similarity which is implied in their mass spectra and strong decays are also discussed. The recent discovered $\bar{b}q$ states, including the $B_J(5840)$, $B_J(5970)$, $B_{sJ}(6064)$, and $B_{sJ}(6114)$, are analyzed. According to our result, the $B_J(5840)$ could be assigned as a 2$S$ state, while the $B_J(5970)$ could be regarded as a member of the $1D(2^-,~3^-)_{j_q=5/2}$ doublet. The $B_{sJ}(6064)$ and $B_{sJ}(6114)$ are probably the $D$-wave states. Especially, they could be explained as the members of the $1D(1^-,~2^-)_{j_q=3/2}$ and $1D(2^-,~3^-)_{j_q=5/2}$ doublets, respectively. The predicted masses and decay properties of other unknown $\bar{b}q/bbq$ states may provide useful clues to the future experiment.


title: CLIP-TD: CLIP Targeted Distillation for Vision-Language Tasks

abstract: Contrastive language-image pretraining (CLIP) links vision and language modalities into a unified embedding space, yielding the tremendous potential for vision-language (VL) tasks. While early concurrent works have begun to study this potential on a subset of tasks, important questions remain: 1) What is the benefit of CLIP on unstudied VL tasks? 2) Does CLIP provide benefit in low-shot or domain-shifted scenarios? 3) Can CLIP improve existing approaches without impacting inference or pretraining complexity? In this work, we seek to answer these questions through two key contributions. First, we introduce an evaluation protocol that includes Visual Commonsense Reasoning (VCR), Visual Entailment (SNLI-VE), and Visual Question Answering (VQA), across a variety of data availability constraints and conditions of domain shift. Second, we propose an approach, named CLIP Targeted Distillation (CLIP-TD), to intelligently distill knowledge from CLIP into existing architectures using a dynamically weighted objective applied to adaptively selected tokens per instance. Experiments demonstrate that our proposed CLIP-TD leads to exceptional gains in the low-shot (up to 51.9%) and domain-shifted (up to 71.3%) conditions of VCR, while simultaneously improving performance under standard fully-supervised conditions (up to 2%), achieving state-of-art performance on VCR compared to other single models that are pretrained with image-text data only. On SNLI-VE, CLIP-TD produces significant gains in low-shot conditions (up to 6.6%) as well as fully supervised (up to 3%). On VQA, CLIP-TD provides improvement in low-shot (up to 9%), and in fully-supervised (up to 1.3%). Finally, CLIP-TD outperforms concurrent works utilizing CLIP for finetuning, as well as baseline naive distillation approaches. Code will be made available.


title: Learning Hierarchical Graph Representation for Image Manipulation Detection

abstract: The objective of image manipulation detection is to identify and locate the manipulated regions in the images. Recent approaches mostly adopt the sophisticated Convolutional Neural Networks (CNNs) to capture the tampering artifacts left in the images to locate the manipulated regions. However, these approaches ignore the feature correlations, i.e., feature inconsistencies, between manipulated regions and non-manipulated regions, leading to inferior detection performance. To address this issue, we propose a hierarchical Graph Convolutional Network (HGCN-Net), which consists of two parallel branches: the backbone network branch and the hierarchical graph representation learning (HGRL) branch for image manipulation detection. Specifically, the feature maps of a given image are extracted by the backbone network branch, and then the feature correlations within the feature maps are modeled as a set of fully-connected graphs for learning the hierarchical graph representation by the HGRL branch. The learned hierarchical graph representation can sufficiently capture the feature correlations across different scales, and thus it provides high discriminability for distinguishing manipulated and non-manipulated regions. Extensive experiments on four public datasets demonstrate that the proposed HGCN-Net not only provides promising detection accuracy, but also achieves strong robustness under a variety of common image attacks in the task of image manipulation detection, compared to the state-of-the-arts.


title: Erosion of N = 28 shell closure: Shape coexistence and monopole transition

abstract: Background: In neutron-rich nuclei neighboring 42Si, the quenching of the N = 28 shell gap occurs and is expected to induce the shape coexistence in their excitation spectra. Purpose: We show that different nuclear shapes coexist in N = 28 isotones 40Mg, 42Si, and 44S, and investigate observables to probe it. Method: Antisymmetrized molecular dynamics with Gogny D1S density functional is applied to describe the shape coexistence phenomena without ad hoc assumption of the nuclear shape. Results: We find that rigid shapes with different deformations coexist in the ground and the first excited 0+ states of 40Mg and 42Si, while in 44S the states exhibit large-amplitude collective motion, which does not have any particular shape. These characteristics are reflected well in the monopole transition strengths. Conclusion: The quenching of the N = 28 shell gap leads to the unique shape coexistence in the N = 28 isotones, which can be probed by the monopole transition strengths.


title: Beam Spin Asymmetries of $\pi^+\pi^0$ Dihadrons from SIDIS at CLAS12

abstract: Spin asymmetries provide a wide range of insights into nucleon structure and hadronization. Recent measurements of beam spin asymmetries of $\pi^+\pi^-$ dihadrons from Semi-Inclusive Deep Inelastic Scattering (SIDIS) at CLAS12 provide the first empirical evidence of a nonzero $G_1^\perp$, the parton helicity-dependent Dihadron Fragmentation Function (DiFF) encoding spin-momentum correlations in hadronization. These measurements have been extended to aid in the characterization of $H_1^\perp$ and $H_1^\sphericalangle$, the DiFFs dependent on parton transverse spin, via a multidimensional partial wave analysis, giving access to the dependence on the interference of dihadrons of particular polarizations. Reconstruction of $\pi^0$s allows for further extension of these measurements to $\pi^+\pi^0$ and $\pi^-\pi^0$ dihadrons. The DiFFs describing $\pi^+\pi^-$ production differ from those describing $\pi^+\pi^0$ and $\pi^-\pi^0$ production, which involve different quark flavors along with a strong suppression of the exclusive diffractive contribution. This presentation will focus on beam spin asymmetries for $\pi^+\pi^0$ dihadrons, compared to those from $\pi^+\pi^-$ dihadrons, which will help shed light on a more comprehensive picture of dihadron fragmentation.


title: The girths of the cubic Pancake graphs

abstract: The Pancake graphs $P_n, n\geqslant 2$, are Cayley graphs over the symmetric group $\mathrm{Sym}_n$ generated by prefix-reversals. There are six generating sets of prefix-reversals of cardinality three which give connected Cayley graphs over the symmetric group known as cubic Pancake graphs. In this paper we study the girth of the cubic Pancake graphs. It is proved that considered cubic Pancake graphs have the girths at most twelve.


title: Fast and Flexible Analysis of Direct Dark Matter Search Data with Machine Learning

abstract: We present the results from combining machine learning with the profile likelihood fit procedure, using data from the Large Underground Xenon (LUX) dark matter experiment. This approach demonstrates reduction in computation time by a factor of 30 when compared with the previous approach, without loss of performance on real data. We establish its flexibility to capture non-linear correlations between variables (such as smearing in light and charge signals due to position variation) by achieving equal performance using pulse areas with and without position-corrections applied. Its efficiency and scalability furthermore enables searching for dark matter using additional variables without significant computational burden. We demonstrate this by including a light signal pulse shape variable alongside more traditional inputs such as light and charge signal strengths. This technique can be exploited by future dark matter experiments to make use of additional information, reduce computational resources needed for signal searches and simulations, and make inclusion of physical nuisance parameters in fits tractable.

categories: astro-ph.CO astro-ph.IM hep-ex physics.ins-det


title: Wrapped Classifier with Dummy Teacher for training physics-based classifier at unlabeled radar data

abstract: In the paper a method for automatic classification of signals received by EKB and MAGW ISTP SB RAS coherent scatter radars (8-20MHz operating frequency) during 2021 is described. The method is suitable for automatic physical interpretation of the resulting classification of the experimental data in realtime. We called this algorithm Wrapped Classifier with Dummy Teacher. The method is trained on unlabeled dataset and is based on training optimal physics-based classification using clusterization results. The approach is close to optimal embedding search, where the embedding is interpreted as a vector of probabilities for soft classification. The approach allows to find optimal classification algorithm, based on physically interpretable parameters of the received data, both obtained during physics-based numerical simulation and measured experimentally. Dummy Teacher clusterer used for labeling unlabeled dataset is gaussian mixture clustering algorithm. For algorithm functioning we extended the parameters obtained by the radar with additional parameters, calculated during simulation of radiowave propagation using ray-tracing and IRI-2012 and IGRF models for ionosphere and Earth's magnetic field correspondingly. For clustering by Dummy Teacher we use the whole dataset of available parameters (measured and simulated ones). For classification by Wrapped Classifier we use only well physically interpreted parameters. As a result we trained the classification network and found 11 well-interpretable classes from physical point of view in the available data. Five other found classes are not interpretable from physical point of view, demonstrating the importance of taking into account radiowave propagation for correct classification.


title: A short pre-history of Quantum Gravity

abstract: I describe the early, from the nineteen sixties, history of attempts at quantizing General Relativity.


title: A unified algorithm framework for mean-variance optimization in discounted Markov decision processes

abstract: This paper studies the risk-averse mean-variance optimization in infinite-horizon discounted Markov decision processes (MDPs). The involved variance metric concerns reward variability during the whole process, and future deviations are discounted to their present values. This discounted mean-variance optimization yields a reward function dependent on a discounted mean, and this dependency renders traditional dynamic programming methods inapplicable since it suppresses a crucial property -- time consistency. To deal with this unorthodox problem, we introduce a pseudo mean to transform the untreatable MDP to a standard one with a redefined reward function in standard form and derive a discounted mean-variance performance difference formula. With the pseudo mean, we propose a unified algorithm framework with a bilevel optimization structure for the discounted mean-variance optimization. The framework unifies a variety of algorithms for several variance-related problems including, but not limited to, risk-averse variance and mean-variance optimizations in discounted and average MDPs. Furthermore, the convergence analyses missing from the literature can be complemented with the proposed framework as well. Taking the value iteration as an example, we develop a discounted mean-variance value iteration algorithm and prove its convergence to a local optimum with the aid of a Bellman local-optimality equation. Finally, we conduct a numerical experiment on portfolio management to validate the proposed algorithm.


title: A Review on Serious Games for Phobia

abstract: Phobia is a widespread mental illness, and severe phobias can seriously impact patients daily lives. One-session Exposure Treatment (OST) has been used to treat phobias in the early days,but it has many disadvantages. As a new way to treat a phobia, virtual reality exposure therapy(VRET) based on serious games is introduced. There have been much researches in the field of serious games for phobia therapy (SGPT), so this paper presents a detailed review of SGPT from three perspectives. First, SGPT in different stages has different forms with the update and iteration of technology. Therefore, we reviewed the development history of SGPT from the perspective of equipment. Secondly, there is no unified classification framework for a large number of SGPT. So we classified and combed SGPT according to different types of phobias. Finally, most articles on SGPT have studied the therapeutic effects of serious games from a medical perspective, and few have studied serious games from a technical perspective. Therefore, we conducted in-depth research on SGPT from a technical perspective in order to provide technical guidance for the development of SGPT. Accordingly, the challenges facing the existing technology has been explored and listed.


title: Real-World Graph Convolution Networks (RW-GCNs) for Action Recognition in Smart Video Surveillance

abstract: Action recognition is a key algorithmic part of emerging on-the-edge smart video surveillance and security systems. Skeleton-based action recognition is an attractive approach which, instead of using RGB pixel data, relies on human pose information to classify appropriate actions. However, existing algorithms often assume ideal conditions that are not representative of real-world limitations, such as noisy input, latency requirements, and edge resource constraints. To address the limitations of existing approaches, this paper presents Real-World Graph Convolution Networks (RW-GCNs), an architecture-level solution for meeting the domain constraints of Real World Skeleton-based Action Recognition. Inspired by the presence of feedback connections in the human visual cortex, RW-GCNs leverage attentive feedback augmentation on existing near state-of-the-art (SotA) Spatial-Temporal Graph Convolution Networks (ST-GCNs). The ST-GCNs' design choices are derived from information theory-centric principles to address both the spatial and temporal noise typically encountered in end-to-end real-time and on-the-edge smart video systems. Our results demonstrate RW-GCNs' ability to serve these applications by achieving a new SotA accuracy on the NTU-RGB-D-120 dataset at 94.1%, and achieving 32X less latency than baseline ST-GCN applications while still achieving 90.4% accuracy on the Northwestern UCLA dataset in the presence of spatial keypoint noise. RW-GCNs further show system scalability by running on the 10X cost effective NVIDIA Jetson Nano (as opposed to NVIDIA Xavier NX), while still maintaining a respectful range of throughput (15.6 to 5.5 Actions per Second) on the resource constrained device. The code is available here: https://github.com/TeCSAR-UNCC/RW-GCN.


title: Operation and performance of a dual-phase crystalline/vapor xenon time projection chamber

abstract: We have built and operated a crystalline/vapor xenon TPC, with the goal of improving searches for dark matter. The motivation for this instrument is the fact that beta decays from the radon decay chain to the ground state presently limit the state-of-the-art liquid/vapor xenon experiments. In contrast, a crystalline xenon target has the potential to tag and reject radon-chain backgrounds, due to the time and energy signature of their decays. The present article is the first demonstration of a crystalline/vapor xenon TPC with electroluminescence (gas gain) for the electron signal readout. It also shows that the scintillation yield in crystalline xenon appears to be identical to that in liquid xenon, in contrast to previous results.


title: Solving, Tracking and Stopping Streaming Linear Inverse Problems

abstract: In large-scale applications including medical imaging, collocation differential equation solvers, and estimation with differential privacy, the underlying linear inverse problem can be reformulated as a streaming problem. In theory, the streaming problem can be effectively solved using memory-efficient, exponentially-converging streaming solvers. In practice, a streaming solver's effectiveness is undermined if it is stopped before, or well-after, the desired accuracy is achieved. In special cases when the underlying linear inverse problem is finite-dimensional, streaming solvers can periodically evaluate the residual norm at a substantial computational cost. When the underlying system is infinite dimensional, streaming solver can only access noisy estimates of the residual. While such noisy estimates are computationally efficient, they are useful only when their accuracy is known. In this work, we rigorously develop a general family of computationally-practical residual estimators and their uncertainty sets for streaming solvers, and we demonstrate the accuracy of our methods on a number of large-scale linear problems. Thus, we further enable the practical use of streaming solvers for important classes of linear inverse problems.


title: Kformer: Knowledge Injection in Transformer Feed-Forward Layers

abstract: Recent days have witnessed a diverse set of knowledge injection models for pre-trained language models (PTMs); however, most previous studies neglect the PTMs' own ability with quantities of implicit knowledge stored in parameters. A recent study has observed knowledge neurons in the Feed Forward Network (FFN), which are responsible for expressing factual knowledge. In this work, we propose a simple model, Kformer, which takes advantage of the knowledge stored in PTMs and external knowledge via knowledge injection in Transformer FFN layers. Empirically results on two knowledge-intensive tasks, commonsense reasoning (i.e., SocialIQA) and medical question answering (i.e., MedQA-USMLE), demonstrate that Kformer can yield better performance than other knowledge injection technologies such as concatenation or attention-based injection. We think the proposed simple model and empirical findings may be helpful for the community to develop more powerful knowledge injection methods. Code available in https://github.com/zjunlp/Kformer.


title: Predicting Research Trends in Artificial Intelligence with Gradient Boosting Decision Trees and Time-aware Graph Neural Networks

abstract: The Science4cast 2021 competition focuses on predicting future edges in an evolving semantic network, where each vertex represents an artificial intelligence concept, and an edge between a pair of vertices denotes that the two concepts have been investigated together in a scientific paper. In this paper, we describe our solution to this competition. We present two distinct approaches: a tree-based gradient boosting approach and a deep learning approach, and demonstrate that both approaches achieve competitive performance. Our final solution, which is based on a blend of the two approaches, achieved the 1st place among all the participating teams. The source code for this paper is available at https://github.com/YichaoLu/Science4cast2021.


title: Task Allocation on Networks with Execution Uncertainty

abstract: We study a single task allocation problem where each worker connects to some other workers to form a network and the task requester only connects to some of the workers. The goal is to design an allocation mechanism such that each worker is incentivized to invite her neighbours to join the allocation, although they are competing for the task. Moreover, the performance of each worker is uncertain, which is modelled as the quality level of her task execution. The literature has proposed solutions to tackle the uncertainty problem by paying them after verifying their execution. Here, we extend the problem to the network setting. The challenge is that the requester relies on the workers to invite each other to find the best worker, and the performance of each worker is also unknown to the task requester. In this paper, we propose a new mechanism to solve the two challenges at the same time. The mechanism guarantees that inviting more workers and reporting/performing according to her true ability is a dominant strategy for each worker. We believe that the new solution can be widely applied in the digital economy powered by social connections such as crowdsourcing and contests.


title: Deep Optimal Transport for Domain Adaptation on SPD Manifolds

abstract: The machine learning community has shown increasing interest in addressing the domain adaptation problem on symmetric positive definite (SPD) manifolds. This interest is primarily driven by the complexities of neuroimaging data generated from brain signals, which often exhibit shifts in data distribution across recording sessions. These neuroimaging data, represented by signal covariance matrices, possess the mathematical properties of symmetry and positive definiteness. However, applying conventional domain adaptation methods is challenging because these mathematical properties can be disrupted when operating on covariance matrices. In this study, we introduce a novel geometric deep learning-based approach utilizing optimal transport on SPD manifolds to manage discrepancies in both marginal and conditional distributions between the source and target domains. We evaluate the effectiveness of this approach in three cross-session brain-computer interface scenarios and provide visualized results for further insights. The GitHub repository of this study can be accessed at https://github.com/GeometricBCI/Deep-Optimal-Transport-for-Domain-Adaptation-on-SPD-Manifolds.


title: State-space renormalization group theory of nonequilibrium reaction networks: Exact solutions for hypercubic lattices in arbitrary dimensions

abstract: Nonequilibrium reaction networks (NRNs) underlie most biological functions. Despite their diverse dynamic properties, NRNs share the signature characteristics of persistent probability fluxes and continuous energy dissipation even in the steady state. Dynamics of NRNs can be described at different coarse-grained levels. Our previous work showed that the apparent energy dissipation rate at a coarse-grained level follows an inverse power law dependence on the scale of coarse-graining. The scaling exponent is determined by the network structure and correlation of stationary probability fluxes. However, it remains unclear whether and how the (renormalized) flux correlation varies with coarse-graining. Following Kadanoff's real space renormalization group (RG) approach for critical phenomena, we address this question by developing a State-Space Renormalization Group (SSRG) theory for NRNs, which leads to an iterative RG equation for the flux correlation function. In square and hypercubic lattices, we solve the RG equation exactly and find two types of fixed point solutions: a family of nontrivial fixed points where the correlation exhibits power-law decay and a trivial fixed point where the correlation vanishes beyond the nearest neighbors. The power-law fixed point is stable if and only if the power exponent is less than the lattice dimension $n$. Consequently, the correlation function converges to the power-law fixed point only when the correlation in the fine-grained network decays slower than $r^{-n}$ and to the trivial fixed point otherwise. If the flux correlation in the fine-grained network contains multiple stable solutions with different exponents, the RG iteration dynamics select the fixed point solution with the smallest exponent. We also discuss a possible connection between the RG flows of flux correlation with those of the Kosterlitz-Thouless transition.


title: Infrared tip-tilt sensing: on-sky experience, lessons learned and unsolved problems

abstract: Infrared tip-tilt sensors (IR TTSs) have been deployed on three different laser guide star adaptive optics (AO) systems on three different telescopes. These IR TTS benefit from the high-order loop PSF sharpening in the near infrared, hence they provide a low tip-tilt residual and a good sky coverage. Nevertheless, these IR TTS are challenging and their use in AO is limited. In this paper, we outline existing IR TTS, provide on-sky performance results and describe our experience using IR TTS and along with plans for the near future. The second part of the paper deals with unresolved challenges for IR TTS. These include algorithms and loop stability in the low Strehl regime, using IR TTSs to measure higher-order modes and guiding on multiple guide stars with different magnitudes.


title: Concise Logarithmic Loss Function for Robust Training of Anomaly Detection Model

abstract: Recently, deep learning-based algorithms are widely adopted due to the advantage of being able to establish anomaly detection models without or with minimal domain knowledge of the task. Instead, to train the artificial neural network more stable, it should be better to define the appropriate neural network structure or the loss function. For the training anomaly detection model, the mean squared error (MSE) function is adopted widely. On the other hand, the novel loss function, logarithmic mean squared error (LMSE), is proposed in this paper to train the neural network more stable. This study covers a variety of comparisons from mathematical comparisons, visualization in the differential domain for backpropagation, loss convergence in the training process, and anomaly detection performance. In an overall view, LMSE is superior to the existing MSE function in terms of strongness of loss convergence, anomaly detection performance. The LMSE function is expected to be applicable for training not only the anomaly detection model but also the general generative neural network.


title: Indirect Adaptive Control of Nonlinearly Parameterized Nonlinear Dissipative Systems

abstract: In this note we address the problem of indirect adaptive (regulation or tracking) control of nonlinear, input affine dissipative systems. It is assumed that the supply rate, the storage and the internal dissipation functions may be expressed as nonlinearly parameterized regression equations where the mappings (depending on the unknown parameters) satisfy a monotonicity condition -- this encompasses a large class of physical systems, including passive systems. We propose to estimate the system parameters using the "power-balance" equation, which is the differential version of the classical dissipation inequality, with a new estimator that ensures global, exponential, parameter convergence under the very weak assumption of interval excitation of the power-balance equation regressor. To design the indirect adaptive controller we make the standard assumption of existence of an asymptotically stabilizing controller that depends -- possibly nonlinearly -- on the unknown plant parameters, and apply a certainty-equivalent control law. The benefits of the proposed approach, with respect to other existing solutions, are illustrated with examples.


title: Multiplicity, localization, and domains in the Hartree-Fock ground state of the two-dimensional Hubbard model

abstract: We explore certain properties of the Hartree-Fock approximation to the ground state of the two-dimensional Hubbard model, emphasizing the fact that in the Hartree approach there is an enormous multiplicity of self-consistent solutions which are nearly degenerate in energy, reminiscent of a spin glass, but which may differ substantially in other bulk properties. It is argued that this multiplicity is physically relevant at low temperatures. We study the localization properties of the one-particle wavefunctions comprising the Hartree-Fock states, and find that these are unlocalized at small and moderate values of U/t, in particular in the stripe region, but become highly localized at values corresponding to strong repulsion. We also find rectangular domains as well as stripes in the stripe region of the phase diagram, and study pair correlations in the neighborhood of half-filling.


title: Optimal Single-User Interactive Beam Alignment with Feedback Delay

abstract: Communication in Millimeter wave (mmWave) band relies on narrow beams due to directionality, high path loss, and shadowing. One can use beam alignment (BA) techniques to find and adjust the direction of these narrow beams. In this paper, BA at the base station (BS) is considered, where the BS sends a set of BA packets to scan different angular regions while the user listens to the channel and sends feedback to the BS for each received packet. It is assumed that the packets and feedback received at the user and BS, respectively, can be correctly decoded. Motivated by practical constraints such as propagation delay, a feedback delay for each BA packet is considered. At the end of the BA, the BS allocates a narrow beam to the user including its angle of departure for data transmission and the objective is to maximize the resulting expected beamforming gain. A general framework for studying this problem is proposed based on which a lower bound on the optimal performance as well as an optimality achieving scheme are obtained. Simulation results reveal significant performance improvements over the state-of-the-art BA methods in the presence of feedback delay.


title: Moses: Efficient Exploitation of Cross-device Transferable Features for Tensor Program Optimization

abstract: Achieving efficient execution of machine learning models has attracted significant attention recently. To generate tensor programs efficiently, a key component of DNN compilers is the cost model that can predict the performance of each configuration on specific devices. However, due to the rapid emergence of hardware platforms, it is increasingly labor-intensive to train domain-specific predictors for every new platform. Besides, current design of cost models cannot provide transferable features between different hardware accelerators efficiently and effectively. In this paper, we propose Moses, a simple and efficient design based on the lottery ticket hypothesis, which fully takes advantage of the features transferable to the target device via domain adaptation. Compared with state-of-the-art approaches, Moses achieves up to 1.53X efficiency gain in the search stage and 1.41X inference speedup on challenging DNN benchmarks.


title: Parameter Identification and Motion Control for Articulated Rigid Body Robots Using Differentiable Position-based Dynamics

abstract: Simulation modeling of robots, objects, and environments is the backbone for all model-based control and learning. It is leveraged broadly across dynamic programming and model-predictive control, as well as data generation for imitation, transfer, and reinforcement learning. In addition to fidelity, key features of models in these control and learning contexts are speed, stability, and native differentiability. However, many popular simulation platforms for robotics today lack at least one of the features above. More recently, position-based dynamics (PBD) has become a very popular simulation tool for modeling complex scenes of rigid and non-rigid object interactions, due to its speed and stability, and is starting to gain significant interest in robotics for its potential use in model-based control and learning. Thus, in this paper, we present a mathematical formulation for coupling position-based dynamics (PBD) simulation and optimal robot design, model-based motion control and system identification. Our framework breaks down PBD definitions and derivations for various types of joint-based articulated rigid bodies. We present a back-propagation method with automatic differentiation, which can integrate both positional and angular geometric constraints. Our framework can critically provide the native gradient information and perform gradient-based optimization tasks. We also propose articulated joint model representations and simulation workflow for our differentiable framework. We demonstrate the capability of the framework in efficient optimal robot design, accurate trajectory torque estimation and supporting spring stiffness estimation, where we achieve minor errors. We also implement impedance control in real robots to demonstrate the potential of our differentiable framework in human-in-the-loop applications.


title: Towards a Conceptual Approach of Analytical Engineering for Big Data

abstract: Analytics corresponds to a relevant and challenging phase of Big Data. The generation of knowledge from extensive data sets (petabyte era) of varying types, occurring at a speed able to serve decision makers, is practiced using multiple areas of knowledge, such as computing, statistics, data mining, among others. In the Big Data domain, Analytics is also considered as a process capable of adding value to the organizations. Besides the demonstration of value, Analytics should also consider operational tools and models to support decision making. To adding value, Analytics is also presented as part of some Big Data value chains, such the Information Value Chain presented by NIST among others, which are detailed in this article. As well, some maturity models are presented, since they represent important structures to favor continuous implementation of Analytics for Big Data, using specific technologies, techniques and methods. Hence, through an in-depth research, using specific literature references and use cases, we seeks to outline an approach to determine the Analytical Engineering for Big Data Analytics considering four pillars: Data, Models, Tools and People; and three process groups: Acquisition, Retention and Revision; in order to make feasible and to define an organization, possibly designated as an Analytics Organization, responsible for generating knowledge from the data in the field of Big Data Analytics.


title: A Neural Network Model of a Quasi-Periodic Elliptically Polarizing Undulator in Universal Mode

abstract: Machine learning has recently been applied and deployed at several light source facilities in the domain of Accelerator Physics. We introduce an approach based on machine learning to produce a fast-executing model that predicts the polarization and energy of the radiated light produced at an insertion device. This paper demonstrates how a machine learning model can be trained on simulated data and later calibrated to a smaller, limited measured data set, a technique referred to as transfer learning. This result will enable users to efficiently determine the insertion device settings for achieving arbitrary beam characteristics.


title: Block Policy Mirror Descent

abstract: In this paper, we present a new policy gradient (PG) methods, namely the block policy mirror descent (BPMD) method for solving a class of regularized reinforcement learning (RL) problems with (strongly)-convex regularizers. Compared to the traditional PG methods with a batch update rule, which visits and updates the policy for every state, BPMD method has cheap per-iteration computation via a partial update rule that performs the policy update on a sampled state. Despite the nonconvex nature of the problem and a partial update rule, we provide a unified analysis for several sampling schemes, and show that BPMD achieves fast linear convergence to the global optimality. In particular, uniform sampling leads to comparable worst-case total computational complexity as batch PG methods. A necessary and sufficient condition for convergence with on-policy sampling is also identified. With a hybrid sampling scheme, we further show that BPMD enjoys potential instance-dependent acceleration, leading to improved dependence on the state space and consequently outperforming batch PG methods. We then extend BPMD methods to the stochastic setting, by utilizing stochastic first-order information constructed from samples. With a generative model, $\tilde{\mathcal{O}}(\left\lvert \mathcal{S}\right\rvert \left\lvert \mathcal{A}\right\rvert /\epsilon)$ (resp. $\tilde{\mathcal{O}}(\left\lvert \mathcal{S}\right\rvert \left\lvert \mathcal{A} \right\rvert /\epsilon^2)$) sample complexities are established for the strongly-convex (resp. non-strongly-convex) regularizers, where $\epsilon$ denotes the target accuracy. To the best of our knowledge, this is the first time that block coordinate descent methods have been developed and analyzed for policy optimization in reinforcement learning, which provides a new perspective on solving large-scale RL problems.