title: Maximal Inequalities and Some Applications

abstract: A maximal inequality is an inequality which involves the (absolute) supremum $\sup_{s\leq t}|X_{s}|$ or the running maximum $\sup_{s\leq t}X_{s}$ of a stochastic process $(X_t)_{t\geq 0}$. We discuss maximal inequalities for several classes of stochastic processes with values in an Euclidean space: Martingales, L\'evy processes, L\'evy-type - including Feller processes, (compound) pseudo Poisson processes, stable-like processes and solutions to SDEs driven by a L\'evy process -, strong Markov processes and Gaussian processes. Using the Burkholder-Davis-Gundy inequalities we als discuss some relations between maximal estimates in probability and the Hardy-Littlewood maximal functions from analysis. This paper has been accepted for publication in Probability Surveys


title: Coreset of Hyperspectral Images on Small Quantum Computer

abstract: Machine Learning (ML) techniques are employed to analyze and process big Remote Sensing (RS) data, and one well-known ML technique is a Support Vector Machine (SVM). An SVM is a quadratic programming (QP) problem, and a D-Wave quantum annealer (D-Wave QA) promises to solve this QP problem more efficiently than a conventional computer. However, the D-Wave QA cannot solve directly the SVM due to its very few input qubits. Hence, we use a coreset ("core of a dataset") of given EO data for training an SVM on this small D-Wave QA. The coreset is a small, representative weighted subset of an original dataset, and any training models generate competitive classes by using the coreset in contrast to by using its original dataset. We measured the closeness between an original dataset and its coreset by employing a Kullback-Leibler (KL) divergence measure. Moreover, we trained the SVM on the coreset data by using both a D-Wave QA and a conventional method. We conclude that the coreset characterizes the original dataset with very small KL divergence measure. In addition, we present our KL divergence results for demonstrating the closeness between our original data and its coreset. As practical RS data, we use Hyperspectral Image (HSI) of Indian Pine, USA.


title: Setup of Compton polarimeters for measuring entangled annihilation photons

abstract: An experimental setup for studying the Compton scattering of annihilation photons in various (entangled and decoherent) quantum states is presented. Two entangled $\gamma$-quanta with an energy of 511 keV and mutually orthogonal polarizations are produced by positron-electron annihilation in a thin aluminum plate and are emitted in opposite directions. To measure both photons, the setup provides two equivalent arms of Compton polarimeters. A Compton polarimeter consists of a plastic scintillation scatterer and an array of NaI(Tl) detectors for measuring photons deflected at an angle of 90$^\circ$. The intermediate scatterer of the GAGG scintillator with SiPM readout is inserted into one of the arms to create a tagged decoherence process prior to the measurement of annihilation photons in polarimeters. The performance of Compton scatterers and NaI(Tl) counters is discussed. The polarization modulation factor and the analyzing power of Compton polarimeters are evaluated from the angular distributions of scattered gammas. The Compton scattering of photons in entangled and decoherent states is compared reliably for the first time.


title: A Monte Carlo Simulation Study of L-band Emission upon Gamma Radiolysis of Water

abstract: Several studies have confirmed visible light and ultraviolet emission during water molecule radiolysis.However radiofrequency (RF) emissions have been scarcely investigated.This simulation study has revealed that the gamma radiolysis of water creates excited hydrogen atoms which emit radio recombination Lband (1 GHz to 2 GHz) radio waves of sufficient strength that a radio-imaging device can detect.The physical and physicochemical stages of radiolysis of water have been modeled via application of Monte Carlo simulation techniques up to 1ps from the onset of gamma photon interaction with water molecules.


title: ClioQuery: Interactive Query-Oriented Text Analytics for Comprehensive Investigation of Historical News Archives

abstract: Historians and archivists often find and analyze the occurrences of query words in newspaper archives, to help answer fundamental questions about society. But much work in text analytics focuses on helping people investigate other textual units, such as events, clusters, ranked documents, entity relationships, or thematic hierarchies. Informed by a study into the needs of historians and archivists, we thus propose ClioQuery, a text analytics system uniquely organized around the analysis of query words in context. ClioQuery applies text simplification techniques from natural language processing to help historians quickly and comprehensively gather and analyze all occurrences of a query word across an archive. It also pairs these new NLP methods with more traditional features like linked views and in-text highlighting to help engender trust in summarization techniques. We evaluate ClioQuery with two separate user studies, in which historians explain how ClioQuery's novel text simplification features can help facilitate historical research. We also evaluate with a separate quantitative comparison study, which shows that ClioQuery helps crowdworkers find and remember historical information. Such results suggest possible new directions for text analytics in other query-oriented settings.


title: A reflection equivalence for Gorenstein-projective quiver representations

abstract: For $\Lambda$ a selfinjective algebra, and $Q$ a finite quiver without oriented cycles, the algebra $\Lambda Q$ is a Gorenstein algebra and the category ${\rm Gproj}\Lambda Q$ of Gorenstein-projective $\Lambda Q$-modules is a Frobenius category. For a sink $v$ of $Q$, we define a functor $F(v) : \underline{\rm Gproj}\Lambda Q\to \underline{\rm Gproj}\Lambda Q(v)$ between the stable categories modulo projectives, where $Q(v)$ is obtained from $Q$ by changing the direction of each arrow ending in $v$. The functor is given by an explicit construction on the level of objects and homomorphisms. Our main result states that $F(v)$ is an equivalence of categories. In the case where the underlying graph of $Q$ is a tree, we deduce that the stable category $\underline{\rm Gproj}\Lambda Q$ does not depend on the orientation of $Q$. Moreover, if $Q$ is a quiver of type $\mathbb A_3$ and $\Lambda=k[T]/(T^n)$ the bounded polynomial algebra, we use the symmetry of the octahedron in the octahedral axiom to verify that the composition of twelve reflections yields the identity on objects.


title: Rough convergence of sequences in a S-metric space

abstract: Phu introduced the idea of rough convergence of sequences in a normed linear space. Here using the idea of Phu we have brought the idea of rough convergence of sequences in a S-metric space and discussed some of its basic properties.


title: Effect of iron vacancies on the magnetic order and spin dynamics of the spin ladder BaFe$_{2-\delta}$S$_{1.5}$Se$_{1.5}$

abstract: Quasi-one-dimensional iron chalcogenides possess various magnetic states depending on the lattice distortion, electronic correlations, and presence of defects. We present neutron diffraction and inelastic neutron scattering experiments on the spin ladder compound BaFe$_{2-\delta}$S$_{1.5}$Se$_{1.5}$ with $\sim$6% iron vacancies. The data reveal that long-range magnetic order is absent, while the characteristic magnetic excitations that correspond to both the stripe- and block-type antiferromagnetic correlations are observed. First-principles calculations support the existence of both stripe and block-type antiferromagnetic short-range order in the experimental sample. The disappearance of long-range magnetic order may be due to the competition between these two magnetic orders, which is greatly enhanced for a certain concentration of iron vacancies, which we calculate to be about 6%, consistent with the measured iron vacancy concentration. Our results highlight how iron vacancies in the iron-based spin ladder system strongly influence the magnetic ground state.


title: Verification of Strong K-Step Opacity for Discrete-Event Systems

abstract: In this paper, we revisit the verification of strong K-step opacity (K-SSO) for partially-observed discrete-event systems modeled as nondeterministic finite-state automata. As a stronger version of the standard K-step opacity, K-SSO requires that an intruder cannot make sure whether or not a secret state has been visited within the last K observable steps. To efficiently verify K-SSO, we propose a new concurrent-composition structure, which is a variant of our previously- proposed one. Based on this new structure, we design an algorithm for deciding K-SSO and prove that the proposed algorithm not only reduces the time complexity of the existing algorithms, but also does not depend on the value of K. Furthermore, a new upper bound on the value of K in K-SSO is derived, which also reduces the existing upper bound on K in the literature. Finally, we illustrate the proposed algorithm by a simple example.


title: On the Cleaning Lemma of Quantum Coding Theory

abstract: The term "Cleaning Lemma" refers to a family of similar propositions that have been used in Quantum Coding Theory to estimate the minimum distance of a code in terms of its length and dimension. We show that the mathematical core is a simple fact of linear algebra of inner product spaces; moreover, it admits a further reduction to a combinatorial, lattice-theoretical level. Several concrete variants of the Cleaning Lemma and some additional propositions are derived as corollaries of the proposed approach.


title: Activity and Rotation of Nearby Field M Dwarfs in the TESS Southern Continuous Viewing Zone

abstract: The evolution of magnetism in late-type dwarfs remains murky, as we can only weakly predict levels of activity for M dwarfs of a given mass and age. We report results from our spectroscopic survey of M dwarfs in the Southern Continuous Viewing Zone (CVZ) of the Transiting Exoplanet Survey Satellite (TESS). As the TESS CVZs overlap with those of the James Webb Space Telescope, our targets constitute a legacy sample for studies of nearby M dwarfs. For 122 stars, we obtained at least one $R\approx 2000$ optical spectrum with which we measure chromospheric $\mathrm{H}\alpha$ emission, a proxy for magnetic field strength. The fraction of active stars is consistent with what is expected for field M dwarfs; as in previous studies, we find that late-type M dwarfs remain active for longer than their early type counterparts. While the TESS light curves for $\approx$20% of our targets show modulations consistent with rotation, TESS systematics are not well enough understood for confident measurements of rotation periods ($P_{\mathrm{rot}}$) longer than half the length of an observing sector. We report periods for 12 stars for which we measure $P_{\mathrm{rot}} {\lower0.8ex\hbox{$\buildrel <\over\sim$}}$ 15 d or find confirmation for the TESS-derived $P_{\mathrm{rot}}$ in the literature. Our sample of 21 $P_{\mathrm{rot}}$, which includes periods from the literature, is consistent with our targets being spun-down field stars. Finally, we examine the $\mathrm{H}\alpha$-to-bolometric luminosity distribution for our sample. Two stars are rotating fast enough to be magnetically saturated, but are not, hinting at the possibility that fast rotators may appear inactive in $\mathrm{H}\alpha$.


title: Educational Inequality

abstract: This chapter provides new evidence on educational inequality and reviews the literature on the causes and consequences of unequal education. We document large achievement gaps between children from different socio-economic backgrounds, show how patterns of educational inequality vary across countries, time, and generations, and establish a link between educational inequality and social mobility. We interpret this evidence from the perspective of economic models of skill acquisition and investment in human capital. The models account for different channels underlying unequal education and highlight how endogenous responses in parents' and children's educational investments generate a close link between economic inequality and educational inequality. Given concerns over the extended school closures during the Covid-19 pandemic, we also summarize early evidence on the impact of the pandemic on children's education and on possible long-run repercussions for educational inequality.


title: Prospects for detecting axion-like particles via the decay $Z\rightarrow af\bar{f}$ at future $Z$ factories

abstract: We investigate the prospects for detecting axion-like particles (ALPs, dubbed as "a") via the decay $Z\rightarrow a f\bar{f}$ at future $Z$ factories. Considering the decay channels $a\rightarrow \mu^+ \mu^-$ and $a\rightarrow b \bar{b}$ , four types of signals $\mu^+ \mu^- /E$, $b b /E$, $e^+ e^- \mu^+ \mu^-$ and $e^+ e^- b b$ are explored. We demonstrate that these channels are promising for detecting ALPs at $Z$ factories and obtain the sensitivity bounds on the couplings $g_{aZZ}$ and $g_{a\gamma Z}$.


title: The eigenvalues and eigenfunctions of the non-linear equation associated to second order Sobolev embeddings

abstract: We consider the non-linear eigenvalue equations characterizing $L^p$ into $L^q$ Sobolev embeddings of second order for Navier boundary conditions at both ends of a line segment. We give a complete description of the s-numbers and the extremal functions in the general case $(p,q)\in(1,\infty)^2$. Among other results, we show that these can be expressed in terms of those of related first order embeddings, if and only if $\frac{1}{p}+\frac{1}{q}=1$. Our findings shed new light on the surprising nature of higher order Sobolev spaces in the Banach space setting.


title: An Efficient Pattern Mining Convolution Neural Network (CNN) algorithm with Grey Wolf Optimization (GWO)

abstract: Automation of feature analysis in the dynamic image frame dataset deals with complexity of intensity mapping with normal and abnormal class. The threshold-based data clustering and feature analysis requires iterative model to learn the component of image frame in multi-pattern for different image frame data type. This paper proposed a novel model of feature analysis method with the CNN based on Convoluted Pattern of Wavelet Transform (CPWT) feature vectors that are optimized by Grey Wolf Optimization (GWO) algorithm. Initially, the image frame gets normalized by applying median filter to the image frame that reduce the noise and apply smoothening on it. From that, the edge information represents the boundary region of bright spot in the image frame. Neural network-based image frame classification performs repeated learning of the feature with minimum training of dataset to cluster the image frame pixels. Features of the filtered image frame was analyzed in different pattern of feature extraction model based on the convoluted model of wavelet transformation method. These features represent the different class of image frame in spatial and textural pattern of it. Convolutional Neural Network (CNN) classifier supports to analyze the features and classify the action label for the image frame dataset. This process enhances the classification with minimum number of training dataset. The performance of this proposed method can be validated by comparing with traditional state-of-art methods.


title: SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems

abstract: We design deep neural networks (DNNs) and corresponding networks' splittings to distribute DNNs' workload to camera sensors and a centralized aggregator on head mounted devices to meet system performance targets in inference accuracy and latency under the given hardware resource constraints. To achieve an optimal balance among computation, communication, and performance, a split-aware neural architecture search framework, SplitNets, is introduced to conduct model designing, splitting, and communication reduction simultaneously. We further extend the framework to multi-view systems for learning to fuse inputs from multiple camera sensors with optimal performance and systemic efficiency. We validate SplitNets for single-view system on ImageNet as well as multi-view system on 3D classification, and show that the SplitNets framework achieves state-of-the-art (SOTA) performance and system latency compared with existing approaches.


title: Moment sequences and difference equations

abstract: We recall the definition and the properties of a moment sequence and recall that all real sequences that have a finite rank of its Hankel matrix (see definition in the sequel) satisfy a homogeneous linear equation with constant coefficients. Then we analyze cases when a difference equation with constant coefficients and suitably chosen initial conditions and having as an input a positive moment sequence has a solution that is a positive moment sequence. We give one general simple result and give many examples illustrating the theory. The main simple result states that the roots of the odd multiplicity of the characteristic equation must lie outside the support of the measure that produces the moment sequence that is in the input and the initial conditions suitably chosen.


title: Generative Adversarial Networks for Image Augmentation in Agriculture: A Systematic Review

abstract: In agricultural image analysis, optimal model performance is keenly pursued for better fulfilling visual recognition tasks (e.g., image classification, segmentation, object detection and localization), in the presence of challenges with biological variability and unstructured environments. Large-scale, balanced and ground-truthed image datasets, however, are often difficult to obtain to fuel the development of advanced, high-performance models. As artificial intelligence through deep learning is impacting analysis and modeling of agricultural images, data augmentation plays a crucial role in boosting model performance while reducing manual efforts for data preparation, by algorithmically expanding training datasets. Beyond traditional data augmentation techniques, generative adversarial network (GAN) invented in 2014 in the computer vision community, provides a suite of novel approaches that can learn good data representations and generate highly realistic samples. Since 2017, there has been a growth of research into GANs for image augmentation or synthesis in agriculture for improved model performance. This paper presents an overview of the evolution of GAN architectures followed by a systematic review of their application to agriculture (https://github.com/Derekabc/GANs-Agriculture), involving various vision tasks for plant health, weeds, fruits, aquaculture, animal farming, plant phenotyping as well as postharvest detection of fruit defects. Challenges and opportunities of GANs are discussed for future research.


title: Cache-Aided Massive MIMO with Linear Precoding in Multi-cell Systems

abstract: In this paper, we propose a novel joint caching and massive multiple-input multiple-output (MIMO) transmission scheme, referred to as \emph{cache-aided massive MIMO}, for multi-cell downlink transmission to multiple cache-enabled receivers. With the proposed scheme, users who have cached (a portion of) the files that they request are offloaded and, hence, (partially) inactive during downlink transmission. The other users either benefit from the cache-enabled offloading for mitigating pilot contamination or exploit the cached but unrequested files to cancel interference during uplink channel estimation and downlink file reception. Moreover, by redesigning the transmit precoders based on the cache status of the users and channel state information, we gain additional degrees of freedom for massive MIMO transmission. For a given cache status, we analyze the equivalent content delivery rates (ECDRs), i.e., the average rates of delivering a requested file via both caching and massive MIMO transmission to the requesting user, for cache-aided massive MIMO employing re-designed maximum ratio transmission (MRT), zero-forcing (ZF) precoding, and regularized zero-forcing (RZF) precoding. Based on the derived results, the impact of (random) uncoded caching and coded caching on the performance of the re-designed precoding schemes is investigated. Simulation results validate our derivations and show that caching is beneficial for precoded downlink transmission as it enhances the transmit power allocation, mitigates intra- and inter-cell interference, and reduces the impairment caused by pilot contamination. Compared with conventional massive MIMO without caching and with cache-oblivious precoding, the proposed cache-aided massive MIMO scheme achieves a significantly higher ECDR even when the number of users approaches the number of transmit antennas.


title: Recurrence relations of coefficients involving hypergeometric function with an application

abstract: For $a,b,p\in \mathbb{R}$, $-c\notin \mathbb{N\cup }\left\{ 0\right\} $ and $ \theta \in \left[ -1,1\right] $, let \begin{equation*} U_{\theta }\left( x\right) =\left( 1-\theta x\right) ^{p}F\left( a,b;c;x\right) =\sum_{n=0}^{\infty }u_{n}\left( \theta \right) x^{n}. \end{equation*}% In this paper, we prove that the coefficients $u_{n}\left( \theta \right) $ for $n\geq 0$ satisfies a 3-order recurrence relation. In particular, $ u_{n}\left( 1\right) $ satisfies a 2-order recurrence relation. These offer a new way to study for hypergeometric function. As an example, we present the necessary and sufficient conditions such that a hypergeometric mean value is Schur m-power convex or concave on $\mathbb{R}_{+}^{2}$.


title: Impact of LHC probes of SUSY and recent measurement of $(g-2)_{\mu}$ on $\mathbb{Z}_3$-NMSSM

abstract: It is well known that excessively heavy supersymmetric particles (sparticles) are disfavored to explain the $(g-2)_\mu$ anomaly, but some people overlook that moderately light sparticles are also disfavored by the LHC probes of supersymmetry. We take the Next-to-Minimal Supersymmetric Standard Model as an example to emphasize the latter point. It is found that, if the theory is required to explain the anomaly at $2\sigma$ level and meanwhile keep consistent with the LHC results, the following lower bounds may be set: $\tan \beta \gtrsim 20$, $|M_1| \gtrsim 275~{\rm GeV}$, $M_2 \gtrsim 300~{\rm GeV}$, $\mu \gtrsim 460~{\rm GeV}$, $m_{\tilde{\mu}_L} \gtrsim 310~{\rm GeV}$, and $m_{\tilde{\mu}_R} \gtrsim 350~{\rm GeV}$, where $M_1$ and $M_2$ denote gaugino masses, $\mu$ represents the Higgsino mass, and $m_{\tilde{\mu}_L}$ and $m_{\tilde{\mu}_R}$ are the mass of Smuons with $L$ and $R$ denoting their dominant chiral component. This observation has significant impacts on dark matter (DM) physics, e.g., the popular $Z$- and Higgs-funnel regions have been excluded, and the Bino-dominated neutralino DM has to co-annihilate with the Wino-dominated electroweakinos (in most cases) and/or Smuons (in few cases) to obtain the correct density. It is also inferred that these conclusions should apply to the Minimal Supersymmetric Standard Model since the underlying physics for the bounds are the same.


title: Data Augmentation for Biomedical Factoid Question Answering

abstract: We study the effect of seven data augmentation (da) methods in factoid question answering, focusing on the biomedical domain, where obtaining training instances is particularly difficult. We experiment with data from the BioASQ challenge, which we augment with training instances obtained from an artificial biomedical machine reading comprehension dataset, or via back-translation, information retrieval, word substitution based on word2vec embeddings, or masked language modeling, question generation, or extending the given passage with additional context. We show that da can lead to very significant performance gains, even when using large pre-trained Transformers, contributing to a broader discussion of if/when da benefits large pre-trained models. One of the simplest da methods, word2vec-based word substitution, performed best and is recommended. We release our artificial training instances and code.


title: Reduced critical slowing down for statistical physics simulations

abstract: Wang-Landau simulations offer the possibility to integrate explicitly over a collective coordinate and stochastically over the remainder of configuration space. We propose to choose the so-called "slow mode", which is responsible for large autocorrelation times and thus critical slowing down, for collective integration. We study this proposal for the Ising model and the linear-log-relaxation (LLR) method as simulation algorithm. We firstly demonstrate super critical slowing down in a phase with spontaneously broken symmetry and for the heatbath algorithms, for which autocorrelation times grow exponentially with system size. By contrast, using the magnetisation as collective coordinate, we present evidence that super critical slowing down is absent. We still observe a polynomial increase of the autocorrelation time with volume (critical slowing down), which is however reduced by orders of magnitude when compared to local update techniques.


title: Neutron-neutral particle mixing and its observable consequences

abstract: In this work, we explore the mixing between neutron ($n$) and elementary neutral particle ($\eta$), which violates both the baryon number ($\mathcal{B}$) and the lepton number ($\mathcal{L}$) by one unit but conserves their difference $(\mathcal{B}-\mathcal{L})$. Such mixing may give rise to non-trivial effects that are different from the Standard Model predictions. We organize our discussions based on two scenarios, roughly depending on whether an interference between oscillation and decay occurs, or whether the new-physics effects associated with the $n$-$\eta$ mixing contribute to the absorptive mixing amplitude. If an oscillation process is not accompanied by an interference between oscillation and decay, or the new-physics interactions do not contribute to the absorptive mixing amplitude, such a process can be classified as pure oscillation. Otherwise, it can be classified as impure oscillation. In the scenario of pure oscillation, CP-violation arising from the Majorana phase can manifest itself through the $n$-$\bar{n}$ oscillation process and may lead to observable effects. In the scenario of impure oscillation, we analyze the testable implications on the masses and lifetimes of the mass eigenstates formed as a result of the $n$-$\bar{n}$ oscillation mediated by $\eta$. In this scenario, we also suggest a unified interpretation of the neutron lifetime anomaly and the $n$-$\bar{n}$ oscillation measurements based on the $n$-$\eta$ mixing. In both scenarios, we present the lower bounds imposed by the experimental searches for $n$-$\bar{n}$ oscillations on the masses of the color multiplet bosons and point out that they could be within the reach of a direct detection at the LHC or future high-energy experiments.


title: Transverse Peierls Transition

abstract: In the present paper, we have discussed a new type of spontaneous symmetry breaking phases caused by the softening of the transverse acoustic phonon modes through the electron phonon coupling. These new phases include the shear density wave and self-twisting wave, which are caused by the softening of linearly and circularly polarized acoustic phonon modes, respectively. We propose that two of the topological semimetal systems in the quantum limit, where the electrons only occupy the lowest Landau bands under external magnetic field, will be the perfect systems to realize these new phases. Exotic physical effects will be induced in these new phases, including the 3D quantum Hall effect, chiral standing acoustic wave, magneto-acoustic effects and chiral phonon correction to Einstein-de Hass effect.


title: Image Harmonization by Matching Regional References

abstract: To achieve visual consistency in composite images, recent image harmonization methods typically summarize the appearance pattern of global background and apply it to the global foreground without location discrepancy. However, for a real image, the appearances (illumination, color temperature, saturation, hue, texture, etc) of different regions can vary significantly. So previous methods, which transfer the appearance globally, are not optimal. Trying to solve this issue, we firstly match the contents between the foreground and background and then adaptively adjust every foreground location according to the appearance of its content-related background regions. Further, we design a residual reconstruction strategy, that uses the predicted residual to adjust the appearance, and the composite foreground to reserve the image details. Extensive experiments demonstrate the effectiveness of our method. The source code will be available publicly.


title: TOV: The Original Vision Model for Optical Remote Sensing Image Understanding via Self-supervised Learning

abstract: Do we on the right way for remote sensing image understanding (RSIU) by training models via supervised data-dependent and task-dependent way, instead of human vision in a label-free and task-independent way? We argue that a more desirable RSIU model should be trained with intrinsic structure from data rather that extrinsic human labels to realize generalizability across a wide range of RSIU tasks. According to this hypothesis, we proposed \textbf{T}he \textbf{O}riginal \textbf{V}ision model (TOV) in remote sensing filed. Trained by massive unlabeled optical data along a human-like self-supervised learning (SSL) path that is from general knowledge to specialized knowledge, TOV model can be easily adapted to various RSIU tasks, including scene classification, object detection, and semantic segmentation, and outperforms dominant ImageNet supervised pretrained method as well as two recently proposed SSL pretrained methods on majority of 12 publicly available benchmarks. Moreover, we analyze the influences of two key factors on the performance of building TOV model for RSIU, including the influence of using different data sampling methods and the selection of learning paths during self-supervised optimization. We believe that a general model which is trained by a label-free and task-independent way may be the next paradigm for RSIU and hope the insights distilled from this study can help to foster the development of an original vision model for RSIU.


title: Improved Weighted Matching in the Sliding Window Model

abstract: We consider the Maximum-weight Matching (MWM) problem in the streaming sliding window model of computation. In this model, the input consists of a sequence of weighted edges on a given vertex set $V$ of size $n$. The objective is to maintain an approximation of a maximum-weight matching in the graph spanned by the $L$ most recent edges, for some integer $L$, using as little space as possible. Prior to our work, the state-of-the-art results were a $(3.5+\varepsilon)$-approximation algorithm for MWM by Biabani et al. [ISAAC'21] and a $(3+\varepsilon)$-approximation for (unweighted) Maximum Matching (MM) by Crouch et al. [ESA'13]. Both algorithms use space $\tilde{O}(n)$. We give the following results: 1. We give a $(2+\varepsilon)$-approximation algorithm for MWM with space $\tilde{O}(\sqrt{nL})$. Under the reasonable assumption that the graphs spanned by the edges in each sliding window are simple, our algorithm uses space $\tilde{O}(n \sqrt{n})$. 2. In the $\tilde{O}(n)$ space regime, we give a $(3+\varepsilon)$-approximation algorithm for MWM, thereby closing the gap between the best-known approximation ratio for MWM and MM. Similar to Biabani et al.'s MWM algorithm, both our algorithms execute multiple instances of the $(2+\varepsilon)$-approximation $\tilde{O}(n)$-space streaming algorithm for MWM by Paz and Schwartzman [SODA'17] on different portions of the stream. Our improvements are obtained by selecting these substreams differently. Furthermore, our $(2+\varepsilon)$-approximation algorithm runs the Paz-Schwartzman algorithm in reverse direction over some parts of the stream, and in forward direction over other parts, which allows for an improved approximation guarantee at the cost of increased space requirements.


title: Rethinking Exponential Averaging of the Fisher

abstract: In optimization for Machine learning (ML), it is typical that curvature-matrix (CM) estimates rely on an exponential average (EA) of local estimates (giving EA-CM algorithms). This approach has little principled justification, but is very often used in practice. In this paper, we draw a connection between EA-CM algorithms and what we call a "Wake of Quadratic regularized models". The outlined connection allows us to understand what EA-CM algorithms are doing from an optimization perspective. Generalizing from the established connection, we propose a new family of algorithms, "KL-Divergence Wake-Regularized Models" (KLD-WRM). We give three different practical instantiations of KLD-WRM, and show numerically that these outperform K-FAC on MNIST.


title: A note on log-algebraicity on elliptic curves

abstract: We analyze log-algebraic power series identities for formal groups of elliptic curves over $\mathbb{Q}$ which arise from modular parametrizations. We further investigate applications to special values of elliptic curve $L$-functions.


title: The crossover from the Macroscopic Fluctuation Theory to the Kardar-Parisi-Zhang equation controls the large deviations beyond Einstein's diffusion

abstract: We study the crossover from the macroscopic fluctuation theory (MFT) which describes 1D stochastic diffusive systems at late times, to the weak noise theory (WNT) which describes the Kardar-Parisi-Zhang (KPZ) equation at early times. We focus on the example of the diffusion in a time-dependent random field, observed in an atypical direction which induces an asymmetry. The crossover is described by a non-linear system which interpolates between the derivative and the standard non-linear Schrodinger equations in imaginary time. We solve this system using the inverse scattering method for mixed-time boundary conditions introduced by us to solve the WNT. We obtain the rate function which describes the large deviations of the sample-to-sample fluctuations of the cumulative distribution of the tracer position. It exhibits a crossover as the asymmetry is varied, recovering both MFT and KPZ limits. We sketch how it is consistent with extracting the asymptotics of a Fredholm determinant formula, recently derived for sticky Brownian motions. The crossover mechanism studied here should generalize to a larger class of models described by the MFT. Our results apply to study extremal diffusion beyond Einstein's theory.

categories: cond-mat.stat-mech cond-mat.dis-nn math-ph math.MP math.PR nlin.SI


title: Dual-Function Radar-Communication System Aided by Intelligent Reflecting Surfaces

abstract: We propose a novel design of a dual-function radar communication (DFRC) system aided by an Intelligent Reflecting Surface (IRS). We consider a scenario with one target and multiple communication receivers, where there is no line-of-sight between the radar and the target. The radar precoding matrix and the IRS weights are optimally designed to maximize the weighted sum of the signal-to-noise ratio (SNR) at the radar receiver and the SNR at the communication receivers subject to power constraints and constant modulus constraints on the IRS weights. The problem is decoupled into two sub-problems, namely, waveform design and IRS weight design, and is solved via alternating optimization. The former subproblem is solved via linear programming, and the latter via manifold optimization with a quartic polynomial objective. The key contribution of this paper lies in solving the IRS weight design sub-problem that is based on the optimization of a quartic objective function in the IRS weights, and is subject to unit modulus-constraint on the IRS weights. Simulation results are provided to show the convergence behavior of the proposed algorithm under different system configurations, and the effectiveness of using IRS to improve radar and communication performance.


title: Regret Analysis of Online Gradient Descent-based Iterative Learning Control with Model Mismatch

abstract: In Iterative Learning Control (ILC), a sequence of feedforward control actions is generated at each iteration on the basis of partial model knowledge and past measurements with the goal of steering the system toward a desired reference trajectory. This is framed here as an online learning task, where the decision-maker takes sequential decisions by solving a sequence of optimization problems having only partial knowledge of the cost functions. Having established this connection, the performance of an online gradient-descent based scheme using inexact gradient information is analyzed in the setting of dynamic and static regret, standard measures in online learning. Fundamental limitations of the scheme and its integration with adaptation mechanisms are further investigated, followed by numerical simulations on a benchmark ILC problem.


title: Machine Learning-Based CSI Feedback With Variable Length in FDD Massive MIMO

abstract: To fully unlock the benefits of multiple-input multiple-output (MIMO) networks, downlink channel state information (CSI) is required at the base station (BS). In frequency division duplex (FDD) systems, the CSI is acquired through a feedback signal from the user equipment (UE). However, this may lead to an important overhead in FDD massive MIMO systems. Focusing on these systems, in this study, we propose a novel strategy to design the CSI feedback. Our strategy allows to optimally design variable length feedback, that is promising compared to fixed feedback since users experience channel matrices differently sparse. Specifically, principal component analysis (PCA) is used to compress the channel into a latent space with adaptive dimensionality. To quantize this compressed channel, the feedback bits are smartly allocated to the latent space dimensions by minimizing the normalized mean squared error (NMSE) distortion. Finally, the quantization codebook is determined with k-means clustering. Numerical simulations show that our strategy improves the zero-forcing beamforming sum rate by 17%, compared to CsiNetPro. The number of model parameters is reduced by 23.4 times, thus causing a significantly smaller offloading overhead. At the same time, PCA is characterized by a lightweight unsupervised training, requiring eight times fewer training samples than CsiNetPro.


title: ProFairRec: Provider Fairness-aware News Recommendation

abstract: News recommendation aims to help online news platform users find their preferred news articles. Existing news recommendation methods usually learn models from historical user behaviors on news. However, these behaviors are usually biased on news providers. Models trained on biased user data may capture and even amplify the biases on news providers, and are unfair for some minority news providers. In this paper, we propose a provider fairness-aware news recommendation framework (named ProFairRec), which can learn news recommendation models fair for different news providers from biased user data. The core idea of ProFairRec is to learn provider-fair news representations and provider-fair user representations to achieve provider fairness. To learn provider-fair representations from biased data, we employ provider-biased representations to inherit provider bias from data. Provider-fair and -biased news representations are learned from news content and provider IDs respectively, which are further aggregated to build fair and biased user representations based on user click history. All of these representations are used in model training while only fair representations are used for user-news matching to achieve fair news recommendation. Besides, we propose an adversarial learning task on news provider discrimination to prevent provider-fair news representation from encoding provider bias. We also propose an orthogonal regularization on provider-fair and -biased representations to better reduce provider bias in provider-fair representations. Moreover, ProFairRec is a general framework and can be applied to different news recommendation methods. Extensive experiments on a public dataset verify that our ProFairRec approach can effectively improve the provider fairness of many existing methods and meanwhile maintain their recommendation accuracy.


title: The Hausdorff and packing measure of some digital expansions

abstract: We compute the exact Hausdorff and packing measure of sets of real numbers whose digital expansions in a given base are missing the digits beyond a given threshold.


title: News Recommendation with Candidate-aware User Modeling

abstract: News recommendation aims to match news with personalized user interest. Existing methods for news recommendation usually model user interest from historical clicked news without the consideration of candidate news. However, each user usually has multiple interests, and it is difficult for these methods to accurately match a candidate news with a specific user interest. In this paper, we present a candidate-aware user modeling method for personalized news recommendation, which can incorporate candidate news into user modeling for better matching between candidate news and user interest. We propose a candidate-aware self-attention network that uses candidate news as clue to model candidate-aware global user interest. In addition, we propose a candidate-aware CNN network to incorporate candidate news into local behavior context modeling and learn candidate-aware short-term user interest. Besides, we use a candidate-aware attention network to aggregate previously clicked news weighted by their relevance with candidate news to build candidate-aware user representation. Experiments on real-world datasets show the effectiveness of our method in improving news recommendation performance.


title: FUM: Fine-grained and Fast User Modeling for News Recommendation

abstract: User modeling is important for news recommendation. Existing methods usually first encode user's clicked news into news embeddings independently and then aggregate them into user embedding. However, the word-level interactions across different clicked news from the same user, which contain rich detailed clues to infer user interest, are ignored by these methods. In this paper, we propose a fine-grained and fast user modeling framework (FUM) to model user interest from fine-grained behavior interactions for news recommendation. The core idea of FUM is to concatenate the clicked news into a long document and transform user modeling into a document modeling task with both intra-news and inter-news word-level interactions. Since vanilla transformer cannot efficiently handle long document, we apply an efficient transformer named Fastformer to model fine-grained behavior interactions. Extensive experiments on two real-world datasets verify that FUM can effectively and efficiently model user interest for news recommendation.


title: Lagrangian Descriptors and the Action Integral of Classical Mechanics

abstract: In this paper we bring together the method of Lagrangian descriptors and the principle of least action, or more precisely, of stationary action, in both deterministic and stochastic settings. In particular, we show how the action can be used as a Lagrangian descriptor. This provides a direct connection between Lagrangian descriptors and Hamiltonian mechanics, and we illustrate this connection with benchmark examples.


title: On dually-CPT and strong-CPT posets

abstract: A poset is a containment of paths in a tree (CPT) if it admits a representation by containment where each element of the poset is represented by a path in a tree and two elements are comparable in the poset if and only if the corresponding paths are related by the inclusion relation. Recently Alc\'on, Gudi\~{n}o and Gutierrez introduced proper subclasses of CPT posets, namely dually-CPT, and strongly-CPT. A poset $\mathbf{P}$ is dually-CPT, if and only if $\mathbf{P}$ and its dual $\mathbf{P}^{d}$ both admit a CPT representation. A poset $\mathbf{P}$ is strongly-CPT, if and only if $\mathbf{P}$ and all the posets that share the same underlying comparability graph admit a CPT representation. Where as the inclusion between Dually-CPT and CPT was known to be strict. It was raised as an open question by Alc\'on, Gudi\~{n}o and Gutierrez whether strongly-CPT was a strict subclass of dually-CPT. We provide a proof that both classes actually coincide.


title: Deep Non-rigid Structure-from-Motion: A Sequence-to-Sequence Translation Perspective

abstract: Directly regressing the non-rigid shape and camera pose from the individual 2D frame is ill-suited to the Non-Rigid Structure-from-Motion (NRSfM) problem. This frame-by-frame 3D reconstruction pipeline overlooks the inherent spatial-temporal nature of NRSfM, i.e., reconstructing the whole 3D sequence from the input 2D sequence. In this paper, we propose to model deep NRSfM from a sequence-to-sequence translation perspective, where the input 2D frame sequence is taken as a whole to reconstruct the deforming 3D non-rigid shape sequence. First, we apply a shape-motion predictor to estimate the initial non-rigid shape and camera motion from a single frame. Then we propose a context modeling module to model camera motions and complex non-rigid shapes. To tackle the difficulty in enforcing the global structure constraint within the deep framework, we propose to impose the union-of-subspace structure by replacing the self-expressiveness layer with multi-head attention and delayed regularizers, which enables end-to-end batch-wise training. Experimental results across different datasets such as Human3.6M, CMU Mocap and InterHand prove the superiority of our framework. The code will be made publicly available


title: Maximal density and the kappa values for the families $\{a,a+1,2a+1,n\}$ and $\{a,a+1,2a+1,3a+1,n\}$

abstract: Let $M$ be a set of positive integers. We study the maximal density $\mu(M)$ of the sets of nonnegative integers $S$ whose elements do not differ by an element in $M$. In 1973, Cantor and Gordon established a formula for $\mu(M)$ for $|M|\leq 2$. Since then, many researchers have worked upon the problem and found several partial results in the case $|M|\geq 3$, including some results in the case, $M$ is an infinite set. In this paper, we study the maximal density problem for the families $M=\{a,a+1,2a+1,n\}$ and $M=\{a,a+1,2a+1,3a+1,n\}$, where $a$ and $n$ are positive integers. In most of the cases, we find bounds for the parameter \textit{kappa}, denoted by $\kappa(M)$, which actually serves as a lower bound for $\mu(M)$. The parameter $\kappa(M)$ has already got its importance due to its rich connection with the problems such as the "lonely runner conjecture" in Diophantine approximations and coloring parameters such as "circular coloring" and "fractional coloring" in graph theory.


title: Canonical Maps from Spaces of Higher Complex Structures to Hitchin Components

abstract: For $S$ a closed surface of genus $g\geq2$, we construct a canonical diffeomorphism from the degree $3$ Fock-Thomas space $\mathcal{T}^3(S)$ of higher complex structures to the $\text{SL}(3,\mathbb{R})$ Hitchin component. Our construction is equivariant with respect to natural actions of the mapping class group $\text{Mod}(S)$. For all $n \geq 3$, we show that the Fock-Thomas space $\mathcal{T}^n(S)$ has a canonical vector bundle structure over Teichm\"uller space. We then construct a $\text{Mod}(S)$-equivariant bundle isomorphism from $\mathcal{T}^n(S)$ to a sub-bundle of the restriction of the tangent bundle of the $\text{PSL}(n, \mathbb{R})$ Hitchin component to the Fuchsian locus. As consequences, we prove that the higher degree moduli space of complex structures is a bundle over the moduli space of Riemann surfaces and that the action of $\text{Mod}(S)$ on $\mathcal{T}^n(S)$ is a proper action by holomorphic automorphisms with respect to a canonical complex structure. The core of our approach is a careful analysis of higher degree diffeomorphism groups.


title: NeuRL: Closed-form Inverse Reinforcement Learning for Neural Decoding

abstract: Current neural decoding methods typically aim at explaining behavior based on neural activity via supervised learning. However, since generally there is a strong connection between learning of subjects and their expectations on long-term rewards, we propose NeuRL, an inverse reinforcement learning approach that (1) extracts an intrinsic reward function from collected trajectories of a subject in closed form, (2) maps neural signals to this intrinsic reward to account for long-term dependencies in the behavior and (3) predicts the simulated behavior for unseen neural signals by extracting Q-values and the corresponding Boltzmann policy based on the intrinsic reward values for these unseen neural signals. We show that NeuRL leads to better generalization and improved decoding performance compared to supervised approaches. We study the behavior of rats in a response-preparation task and evaluate the performance of NeuRL within simulated inhibition and per-trial behavior prediction. By assigning clear functional roles to defined neuronal populations our approach offers a new interpretation tool for complex neuronal data with testable predictions. In per-trial behavior prediction, our approach furthermore improves accuracy by up to 15% compared to traditional methods.


title: A Comparative Analysis of Decision-Level Fusion for Multimodal Driver Behaviour Understanding

abstract: Visual recognition inside the vehicle cabin leads to safer driving and more intuitive human-vehicle interaction but such systems face substantial obstacles as they need to capture different granularities of driver behaviour while dealing with highly limited body visibility and changing illumination. Multimodal recognition mitigates a number of such issues: prediction outcomes of different sensors complement each other due to different modality-specific strengths and weaknesses. While several late fusion methods have been considered in previously published frameworks, they constantly feature different architecture backbones and building blocks making it very hard to isolate the role of the chosen late fusion strategy itself. This paper presents an empirical evaluation of different paradigms for decision-level late fusion in video-based driver observation. We compare seven different mechanisms for joining the results of single-modal classifiers which have been both popular, (e.g. score averaging) and not yet considered (e.g. rank-level fusion) in the context of driver observation evaluating them based on different criteria and benchmark settings. This is the first systematic study of strategies for fusing outcomes of multimodal predictors inside the vehicles, conducted with the goal to provide guidance for fusion scheme selection.


title: Reducing Model Jitter: Stable Re-training of Semantic Parsers in Production Environments

abstract: Retraining modern deep learning systems can lead to variations in model performance even when trained using the same data and hyper-parameters by simply using different random seeds. We call this phenomenon model jitter. This issue is often exacerbated in production settings, where models are retrained on noisy data. In this work we tackle the problem of stable retraining with a focus on conversational semantic parsers. We first quantify the model jitter problem by introducing the model agreement metric and showing the variation with dataset noise and model sizes. We then demonstrate the effectiveness of various jitter reduction techniques such as ensembling and distillation. Lastly, we discuss practical trade-offs between such techniques and show that co-distillation provides a sweet spot in terms of jitter reduction for semantic parsing systems with only a modest increase in resource usage.


title: Iterative Adaptive Spectroscopy of Short Signals

abstract: We develop an iterative, adaptive frequency sensing protocol based on Ramsey interferometry of a two-level system. Our scheme allows one to estimate unknown frequencies with a high precision from short, finite signals. It avoids several issues related to processing of decaying signals and reduces the experimental overhead related to sampling. High precision is achieved by enhancing the Ramsey sequence to prepare with high fidelity both the sensing and readout state and by using an iterative procedure built to mitigate systematic errors when estimating frequencies from Fourier transforms.


title: Pseudo-Goldstone Dark Matter Model with CP violation

abstract: We consider an explicitly CP-violating model with two Higgs doublets and one complex singlet scalar. The singlet $S$ is charged under a global $\rm U(1)$ symmetry which is softly broken by a mass term $\mu^2 S^2+\hc$. Imaginary part of $S$ is a stable dark matter candidate which at the tree level, in the limit of zero momentum transfer, decouples from nucleons naturally satisfying all existing direct detection limits on dark matter scattering cross-section. It is explicitly shown that within this framework in the alignment limit CP-violation is still present in contrast to a popular version of a 2-Higgs doublet model with softly broken $Z_2$ symmetry. In this context, we investigate dark matter implications of the model both with and without CP violation in the scalar sector. In particular, dark matter relic abundance is calculated and the possibility for its indirect detection is discussed.


title: Sn/Ge substitution in ((C$_\textrm{n}$H$_{2\textrm{n}-1}$NH$_3$)$_2$PbI$_4$; n=3): An emerging 2D layered hybrid perovskites with enhanced optoelectronic properties$^\dag$

abstract: Two-dimensional (2D) perovskites show higher stability in comparison to their three-dimensional (3D) counterparts. Therefore, 2D perovskites have invoked remarkable attention in basic understanding of their physical properties and optoelectronic applications. Here we present a low-dimensional naturally self-assembled inorganic-organic (IO) hybrid systems based on primary cyclic ammonium-based (C$_{\textrm{n}}$H$_{2\textrm{n}-1}$NH$_{3}$) semiconductor series [viz. ((C$_{\textrm{n}}$H$_{2\textrm{n}-1}$ NH$_3$)$_2$PbI$_4$; n=3-6)]. However, the wide bandgap nature and presence of toxicity due to lead (Pb) prohibit their applications. Therefore, in the present work, we study the role of Ge/Sn substitution and Pb-vacancy (Pb-$\boxtimes$) to reduce concentration of Pb and to enhance solar cell efficiency by the formation of mixed perovskite structures. We have discussed the effect of spin-orbit coupling (SOC) using state-of-the-art hybrid density functional theory (DFT). We find the mixed conformers with Pb-$\boxtimes$ do not possess structural stability. Moreover, they have indirect bandgap, which is not good for solar cell applications. Only those conformers, which have favourable thermodynamics and structural stability, are considered for further study of optical properties. Our results infer that Sn substitution is more favorable than that of Ge in replacing Pb and enhancing the efficiency. Exciton binding energies calculated using Wannier-Mott approach for pristine and substituted conformers are larger than lead halide perovskites, while the electron-phonon coupling is smaller in the former. From computed spectroscopic limited maximum efficiency (SLME), these 2D perovskites show enough promise as alternatives to conventional lead halide perovskites.


title: Multi-wavelength temporal and spectral analysis of Blazar S5 1803+78

abstract: Blazars are a class of AGN, one of their jets is pointed towards the earth. Here, we report about the multi-wavelength study for blazar S5 1803+78 between MJD 58727 to MJD 59419. We analysed $\gamma$-ray data collected by Fermi-LAT, X-ray data collected by Swift-XRT \& NuSTAR, optical photons detected by Swift-UVOT \& TUBITAK observatory in Turkey. Three flaring states are identified by analysing the $\gamma$-ray light curve. A day scale variability is observed throughout the flares with the similar rise and decay times suggesting a compact emission region located close to the central engine. Cross-correlation studies are carried out between $\gamma$-ray, radio, and X-ray bands, and no significant correlation is detected. The $\gamma$-ray and optical emission are significantly correlated with zero time lag suggesting a co-spatial origin of them. A significant positive correlation between the R-I index and the V magnitude is observed. The broadband spectral energy distributions (SEDs) modeling was performed for all the flaring episodes as well as for one quiescent state for comparison. SEDs are best fitted with the synchrotron-self Compton (SSC) model under a one-zone leptonic scenario. The SED modeling shows that to explain the high flaring state strong Doppler boosting is required.


title: Melting temperature prediction via first principles and deep learning

abstract: Melting is a high temperature process that requires extensive sampling of configuration space, thus making melting temperature prediction computationally very expensive and challenging. Over the past few years, I have built two methods to address this challenge, one via direct density functional theory (DFT) molecular dynamics (MD) simulations and the other via deep learning graph neural networks. The DFT approach is based on statistical analysis of small-size solid-liquid coexistence MD simulations. It eliminates the risk of metastable superheated solid in the fast-heating method, while also significantly reducing the computer cost relative to the traditional large-scale coexistence method. Being both accurate and efficient (at the speed of several days per material), it is considered as one of the best methods for direct DFT melting temperature calculation. The deep learning method is based on graph neural networks that effectively handles permutation invariance in chemical formula, which drastically improves efficiency and reduces cost. At the speed of milliseconds per material, the model is extremely fast, while being moderately accurate, especially within the composition space expanded by the dataset. I have implemented both methods into automated computer code packages, making them publicly available and free to download. The DFT and deep learning methods are highly complementary to each other, and hence they can be potentially well integrated into a framework for melting temperature prediction. I demonstrated examples of applying the methods to materials design and discovery of high-melting-point materials.


title: Is GitHub's Copilot as Bad as Humans at Introducing Vulnerabilities in Code?

abstract: Several advances in deep learning have been successfully applied to the software development process. Of recent interest is the use of neural language models to build tools, such as Copilot, that assist in writing code. In this paper we perform a comparative empirical analysis of Copilot-generated code from a security perspective. The aim of this study is to determine if Copilot is as bad as human developers. We investigate whether Copilot is just as likely to introduce the same software vulnerabilities as human developers. Using a dataset of C/C++ vulnerabilities, we prompt Copilot to generate suggestions in scenarios that led to the introduction of vulnerabilities by human developers. The suggestions are inspected and categorized in a 2-stage process based on whether the original vulnerability or fix is reintroduced. We find that Copilot replicates the original vulnerable code about 33% of the time while replicating the fixed code at a 25% rate. However this behaviour is not consistent: Copilot is more likely to introduce some types of vulnerabilities than others and is also more likely to generate vulnerable code in response to prompts that correspond to older vulnerabilities. Overall, given that in a significant number of cases it did not replicate the vulnerabilities previously introduced by human developers, we conclude that Copilot, despite performing differently across various vulnerability types, is not as bad as human developers at introducing vulnerabilities in code.


title: Noether currents in theories with higher derivatives and theories with differential field transformation in action (DFTA)

abstract: The article is devoted to the investigation of the Noether currents and integrals of motion in the special subclass of theories with higher field derivatives -- theories under differential field transformations in action (DFTA). Under fairly general assertions, we derive a simple representation for the integrals as sums of "old" integrals of motion, terms, that vanishes on the "old" equations of motion and surface integrals. We show that for some cosmological theories of that kind with high order derivatives the last contribution can violate gauge invariance, specifically, diffeomorphisms. Then we investigate ambiguity of the Noether procedure for higher derivative theories and fix it in the way the problem resolves in quite general setting. The obtained results are discussed for the several extensions of the General Relativity, which are obtained by DFTA, in particular, for mimetic, disformal and Regge-Teitelboim theories of gravity.


title: Zeroth-Order Stochastic Coordinate Methods for Decentralized Non-convex Optimization

abstract: In this letter, we first propose a \underline{Z}eroth-\underline{O}rder c\underline{O}ordinate \underline{M}ethod~(ZOOM) to solve the stochastic optimization problem over a decentralized network with only zeroth-order~(ZO) oracle feedback available. Moreover, we equip a simple mechanism "powerball" to ZOOM and propose ZOOM-PB to accelerate the convergence of ZOOM. Compared with the existing methods, we verify the proposed algorithms through two benchmark examples in the literature, namely the black-box binary classification and the generating adversarial examples from black-box DNNs in order to compare with the existing state-of-the-art centralized and distributed ZO algorithms. The numerical results demonstrate a faster convergence rate of the proposed algorithms.


title: A Search for Heterocycles in GOTHAM Observations of TMC-1

abstract: We have conducted an extensive search for nitrogen-, oxygen- and sulfur-bearing heterocycles toward Taurus Molecular Cloud 1 (TMC-1) using the deep, broadband centimeter-wavelength spectral line survey of the region from the GOTHAM large project on the Green Bank Telescope. Despite their ubiquity in terrestrial chemistry, and the confirmed presence of a number of cyclic and polycyclic hydrocarbon species in the source, we find no evidence for the presence of any heterocyclic species. Here, we report the derived upper limits on the column densities of these molecules obtained by Markov Chain Monte Carlo (MCMC) analysis and compare this approach to traditional single-line upper limit measurements. We further hypothesize why these molecules are absent in our data, how they might form in interstellar space, and the nature of observations that would be needed to secure their detection.


title: Y-Z cut lithium niobate longitudinal piezoelectric resonant photoelastic modulator

abstract: The capability to modulate the intensity of an optical beam has scientific and practical significance. In this work, we demonstrate Y-Z cut lithium niobate acousto-optic modulators with record-high modulation efficiency, requiring only $1.5~\text{W}/\text{cm}^2$ for 100% modulation at 7 MHz. These modulators use a simple fabrication process; coating the top and bottom surfaces of a thin lithium niobate wafer with transparent electrodes. The fundamental shear acoustic mode of the wafer is excited through the transparent electrodes by applying voltage with frequency corresponding to the resonant frequency of this mode, confining an acoustic standing wave to the electrode region. Polarization of light propagating through this region is modulated at the applied frequency. Polarization modulation is converted to intensity modulation by placing the modulator between polarizers. To showcase an important application space for this modulator, we integrate it with a standard image sensor and demonstrate 4 megapixel time-of-flight imaging


title: CholecTriplet2021: A benchmark challenge for surgical action triplet recognition

abstract: Context-aware decision support in the operating room can foster surgical safety and efficiency by leveraging real-time feedback from surgical workflow analysis. Most existing works recognize surgical activities at a coarse-grained level, such as phases, steps or events, leaving out fine-grained interaction details about the surgical activity; yet those are needed for more helpful AI assistance in the operating room. Recognizing surgical actions as triplets of <instrument, verb, target> combination delivers comprehensive details about the activities taking place in surgical videos. This paper presents CholecTriplet2021: an endoscopic vision challenge organized at MICCAI 2021 for the recognition of surgical action triplets in laparoscopic videos. The challenge granted private access to the large-scale CholecT50 dataset, which is annotated with action triplet information. In this paper, we present the challenge setup and assessment of the state-of-the-art deep learning methods proposed by the participants during the challenge. A total of 4 baseline methods from the challenge organizers and 19 new deep learning algorithms by competing teams are presented to recognize surgical action triplets directly from surgical videos, achieving mean average precision (mAP) ranging from 4.2% to 38.1%. This study also analyzes the significance of the results obtained by the presented approaches, performs a thorough methodological comparison between them, in-depth result analysis, and proposes a novel ensemble method for enhanced recognition. Our analysis shows that surgical workflow analysis is not yet solved, and also highlights interesting directions for future research on fine-grained surgical activity recognition which is of utmost importance for the development of AI in surgery.


title: Magnetically brightened dark electron-phonon bound states in a van der Waals antiferromagnet

abstract: In van der Waals (vdW) materials, strong coupling between different degrees of freedom can hybridize elementary excitations into bound states with mixed character. Correctly identifying the nature and composition of these bound states is key to understanding their ground state properties and excitation spectra. Here, we use ultrafast spectroscopy to reveal bound states of d-orbitals and phonons in 2D vdW antiferromagnet NiPS3. These bound states manifest themselves through equally spaced phonon replicas in frequency domain. These states are optically dark above the N\'eel temperature and become accessible with magnetic order. By launching this phonon and spectrally tracking its amplitude, we establish the electronic origin of bound states as localized d-d excitations. Our data directly yield electron-phonon coupling strength which exceeds the highest known value in 2D systems. These results demonstrate NiPS3 as a platform to study strong interactions between spins, orbitals and lattice, and open pathways to coherent control of 2D magnets.


title: Breaking Character: Are Subwords Good Enough for MRLs After All?

abstract: Large pretrained language models (PLMs) typically tokenize the input string into contiguous subwords before any pretraining or inference. However, previous studies have claimed that this form of subword tokenization is inadequate for processing morphologically-rich languages (MRLs). We revisit this hypothesis by pretraining a BERT-style masked language model over character sequences instead of word-pieces. We compare the resulting model, dubbed TavBERT, against contemporary PLMs based on subwords for three highly complex and ambiguous MRLs (Hebrew, Turkish, and Arabic), testing them on both morphological and semantic tasks. Our results show, for all tested languages, that while TavBERT obtains mild improvements on surface-level tasks \`a la POS tagging and full morphological disambiguation, subword-based PLMs achieve significantly higher performance on semantic tasks, such as named entity recognition and extractive question answering. These results showcase and (re)confirm the potential of subword tokenization as a reasonable modeling assumption for many languages, including MRLs.


title: Minimum-Mass Limits for Streamlined Venus Atmospheric Probes

abstract: Small, expendable drop probes are an attractive method for making measurements in the lower atmosphere of Venus, \,augmenting the capabilities of orbiters or aerial platforms that must remain in the benign temperature region above 50 km altitude. However, probe miniaturization is impeded by the need to provide thermal and pressure protection for conventional payloads. This paper determines the minimum mass limits for an insulated pressure vessel probe that operates all the way to the Venusian surface. Scaling laws for the probe performance and mass of major system components are explicitly derived using a simple model that captures the relevant physics. Streamlining the probe is found to be a highly effective strategy for lowering the system mass, but it also reduces the time available for data collection and transmission. Tradeoffs, guidelines and design charts are presented for an array of miniaturized probes. Total system masses on the order of 5 kilograms are plausible with streamlined probes if the desired science measurements can be performed faster than a standard Venus descent timeline.


title: Exact controllability to the trajectories of the one-phase Stefan problem

abstract: This paper deals with the exact controllability to the trajectories of the one--phase Stefan problem in one spatial dimension. This is a free-boundary problem that models solidification and melting processes. It is assumed that the physical domain is filled by a medium whose state is liquid on the left and solid, with constant temperature, on the right. In between we find a free-boundary (the interface that separates the liquid from the solid). In the liquid domain, a parabolic equation completed with initial and boundary conditions must be satisfied by the temperature. On the interface, an additional free-boundary requirement, called the {\it Stefan condition,} is imposed. We prove the local exact controllability to the (smooth) trajectories. To this purpose, we first reformulate the problem as the local null controllability of a coupled PDE-ODE system with distributed controls. Then, a new Carleman inequality for the adjoint of the linearized PDE-ODE system, coupled on the boundary through nonlocal in space and memory terms, is presented. This leads to the null controllability of an appropriate linear system. Finally, a local result is obtained via local inversion, by using {\it Liusternik-Graves' Theorem}. As a byproduct of our approach, we find that some parabolic equations which contains memory terms localized on the boundary are null-controllable.


title: Nonlinear Optical Limiting with Hybrid Nanostructures of NiCo2O4 and Multiwall Carbon Nanotubes

abstract: Nonlinear optical (NLO) response in terms of reverse saturable absorption (RSA) has been exploited extensively for optical limiting. Here, we experimentally demonstrate that flower-like hybrid nanostructures of NiCo2O4 and Multiwall Carbon Nanotubes (NCO@MWCNT) exhibit a strong non-linearity in their absorption, specifically an excited state absorption (ESA) induced RSA, when exposed to nanosecond laser pulses. We obtain strong nonlinear absorption coefficient (\b{eta}) and nonlinear refractive index (n2) in hybrid NCO@MWCNT, the values that are 2-times and 2-orders of magnitude higher, respectively compared to NCO or MWCNT alone. This offers straightforward application in optical limiting with optical limiting (FOL) and optical onset (FON) threshold ca. 2-10 times lower than benchmark NLO materials, e.g., graphene, family of 2-D transition metal dichalcogenides (TMDC) materials and recently established NCO. Notably, for femtosecond pumping, NLO response of NCO@MWCNT is dominated by saturable absorption (SA) with a week contribution from two photon absorption (TPA), arising respectively from MWCNT and NCO. A remarkable sign reversal along with a larger amplitude is obtained for n2 thanks to the charge transfer from MWCNT to NCO.


title: Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image

abstract: This paper addresses the problem of vehicle-mounted camera localization by matching a ground-level image with an overhead-view satellite map. Existing methods often treat this problem as cross-view image retrieval, and use learned deep features to match the ground-level query image to a partition (eg, a small patch) of the satellite map. By these methods, the localization accuracy is limited by the partitioning density of the satellite map (often in the order of tens meters). Departing from the conventional wisdom of image retrieval, this paper presents a novel solution that can achieve highly-accurate localization. The key idea is to formulate the task as pose estimation and solve it by neural-net based optimization. Specifically, we design a two-branch {CNN} to extract robust features from the ground and satellite images, respectively. To bridge the vast cross-view domain gap, we resort to a Geometry Projection module that projects features from the satellite map to the ground-view, based on a relative camera pose. Aiming to minimize the differences between the projected features and the observed features, we employ a differentiable Levenberg-Marquardt ({LM}) module to search for the optimal camera pose iteratively. The entire pipeline is differentiable and runs end-to-end. Extensive experiments on standard autonomous vehicle localization datasets have confirmed the superiority of the proposed method. Notably, e.g., starting from a coarse estimate of camera location within a wide region of 40m x 40m, with an 80% likelihood our method quickly reduces the lateral location error to be within 5m on a new KITTI cross-view dataset.


title: Dynamic latent space relational event model

abstract: Dynamic relational processes, such as e-mail exchanges, bank loans and scientific citations, are important examples of dynamic networks, in which the relational events consistute time-stamped edges. There are contexts where the network might be considered a reflection of underlying dynamics in some latent space, whereby nodes are associated with dynamic locations and their relative distances drive their interaction tendencies. As time passes nodes can change their locations assuming new configurations, with different interaction patterns. The aim of this paper is to define a dynamic latent space relational event model. We then develop a computationally efficient method for inferring the locations of the nodes. We make use of the Expectation Maximization algorithm which embeds an extension of the universal Kalman filter. Kalman filters are known for being effective tools in the context of tracking objects in the space, with successful applications in fields such as geolocalization. We extend its application to dynamic networks by filtering the signal from a sequence of adjacency matrices and recovering the hidden movements. Besides the latent space our formulation includes also more traditional fixed and random effects, achieving a general model that can suit a large variety of applications.


title: Denoiser-based projections for 2-D super-resolution multi-reference alignment

abstract: We study the 2-D super-resolution multi-reference alignment (SR-MRA) problem: estimating an image from its down-sampled, circularly-translated, and noisy copies. The SR-MRA problem serves as a mathematical abstraction of the structure determination problem for biological molecules. Since the SR-MRA problem is ill-posed without prior knowledge, accurate image estimation relies on designing priors that well-describe the statistics of the images of interest. In this work, we build on recent advances in image processing, and harness the power of denoisers as priors of images. In particular, we suggest to use denoisers as projections, and design two computational frameworks to estimate the image: projected expectation-maximization and projected method of moments. We provide an efficient GPU implementation, and demonstrate the effectiveness of these algorithms by extensive numerical experiments on a wide range of parameters and images.


title: Pseudo-Geometric Strongly Regular Graphs with a Regular Point

abstract: We study pseudo-geometric strongly regular graphs whose second subconstituent with respect to a vertex is a cover of a strongly regular graph or a complete graph. By studying the structure of such graphs, we characterize all graphs containing such a vertex, and use our characterization to find many new strongly regular graphs. Thereby, we answer a question posed by Gardiner, Godsil, Hensel, and Royle. We give an explicit construction for q new, pairwise non-isomorphic graphs with the same parameters as the collinearity graph of generalized quadrangles of order $(q,q)$ and a new non-geometric graph with the same parameters as the collinearity graph of the Hermitian generalized quadrangle of order $(q^2, q)$, for prime powers $q$. Using our characterization, we computed 135478 new strongly regular graphs with parameters (85,20,3,5) and 27 039 strongly regular graphs with parameters (156, 30, 4, 6).


title: Towards Evaluation of Autonomously Generated Musical Compositions: A Comprehensive Survey

abstract: There are many applications that aim to create a complete model for an autonomously generated composition; systems are able to generate muzak songs, assist singers in transcribing songs or can imitate long-dead authors. Subjective understanding of creativity or aesthetics differs not only within preferences (popular authors or genres), but also differs on the basis of experienced experience or socio-cultural environment. So, what do we want to achieve with such an adaptation? What is the benefit of the resulting work for the author, who can no longer evaluate this composition? And in what ways should we evaluate such a composition at all?


title: Existence of maximum likelihood estimates in exponential random graph models

abstract: We present a streamlined proof of the foundational result in the theory of exponential random graph models (ERGMs) that the maximum likelihood estimate exists if and only if the target statistic lies in the relative interior of the convex hull of the set of realizable statistics. .


title: Iceberg Sensemaking: A Process Model for Critical Data Analysis and Visualization

abstract: We offer a new model of the sensemaking process for data analysis and visualization. Whereas past sensemaking models have been grounded in positivist assumptions about the nature of knowledge, we reframe data sensemaking in critical, humanistic terms by approaching it through an interpretivist lens. Our three-phase process model uses the analogy of an iceberg, where data is the visible tip of underlying schemas. In the Add phase, the analyst acquires data, incorporates explicit schemas from the data, and absorbs the tacit schemas of both data and people. In the Check phase, the analyst interprets the data with respect to the current schemas and evaluates whether the schemas match the data. In the Refine phase, the analyst considers the role of power, articulates what was tacit into explicitly stated schemas, updates data, and formulates findings. Our model has four important distinguishing features: Tacit and Explicit Schemas, Schemas First and Always, Data as a Schematic Artifact, and Schematic Multiplicity. We compare the roles of schemas in past sensemaking models and draw conceptual distinctions based on a historical review of schemas in different academic traditions. We validate the descriptive and prescriptive power of our model through four analysis scenarios: noticing uncollected data, learning to wrangle data, downplaying inconvenient data, and measuring with sensors. We conclude by discussing the value of interpretivism, the virtue of epistemic humility, and the pluralism this sensemaking model can foster.


title: Small cycle structure for words in conjugation invariant random permutations

abstract: We study the cycle structure of words in several random permutations. We assume that the permutations are independent and that their distribution is conjugation invariant, with a good control on their short cycles. If, after successive cyclic simplifications, the word w still contains at least two different letters, then we get a universal limiting joint law for small cycles for the word in these permutations. These results can be seen as an extension of our previous work [Kammoun and Ma\"ida, 2020] from the product of permutations to any non-trivial word in the permutations and also as an extension of the results of [Nica, 1994] from uniform permutations to general conjugation invariant random permutations.


title: Global Regularity for A Radiation Hydrodynamics Model with Viscosity and Thermal Conductivity

abstract: In this paper, we study the global wellposedness of a radiation hydrodynamics model with viscosity and thermal conductivity. It is now well-understood that, unlike the compressible Euler equations whose smooth solutions must blow up in finite time no matter how small and how smooth the initial data is, the dissipative structure of such a radiation hydrodynamics model can indeed guarantee that its one-dimensional Cauchy problem admits a unique global smooth solution provided that the initial data is sufficiently small, while for large initial data, even if the heat conductivity is taken into account but the viscosity effect is ignored, shock type singularities must appear in finite time for smooth solutions of the Cauchy problem of one-dimensional radiation hydrodynamics model with thermal conductivity and zero viscosity. Thus a natural question is, if effects of both the viscosity and the thermal conductivity are considered, does the one-dimensional radiation hydrodynamics model with viscosity and thermal conductivity exist a unique global large solution? We give an affirmative answer to this problem and show in this paper that the initial-boundary value problem to the radiation hydrodynamics model in an one-dimensional periodic box T = R/Z with viscosity and thermal conductivity does exist a unique global smooth solution for any large initial data. The main ingredient in our analysis is to introduce some delicate estimates, especially an improved estimate on the absolute temperature and a pointwise estimate between the absolute temperature, the specific volume, and the first-order spatial derivative of the macro radiation flux, to deduce the desired positive lower and upper bounds on the density and the absolute temperature.


title: Phase transitions above the upper critical dimension

abstract: These lecture notes provide an overview of the renormalization group (RG) as a successful framework to understand critical phenomena above the upper critical dimension $d_{\rm uc}$. After an introduction to the scaling picture of continuous phase transitions, we discuss the apparent failure of the Gaussian fixed point to capture scaling for Landau mean-field theory, which should hold in the thermodynamic limit above $d_{\rm uc}$. We recount how Fisher's dangerous-irrelevant-variable formalism applied to thermodynamic functions partially repairs the situation but at the expense of hyperscaling and finite-size scaling, both of which were, until recently, believed not to apply above $d_{\rm uc}$. We recall limitations of various attempts to match the RG with analytical and numerical results for Ising systems. We explain how the extension of dangerous irrelevancy to the correlation sector is key to marrying the above concepts into a comprehensive RG scaling picture that renders hyperscaling and finite-size scaling valid in all dimensions. We collect what we believe is the current status of the theory, including some new insights and results. This paper is in grateful memory of Michael Fisher who introduced many of the concepts discussed and who, half a century later, contributed to their advancement.


title: Rockafellian Relaxation and Stochastic Optimization under Perturbations

abstract: In practice, optimization models are often prone to unavoidable inaccuracies due to dubious assumptions and corrupted data. Traditionally, this placed special emphasis on risk-based and robust formulations, and their focus on ``conservative" decisions. We develop, in contrast, an ``optimistic" framework based on Rockafellian relaxations in which optimization is conducted not only over the original decision space but also jointly with a choice of model perturbation. The framework enables us to address challenging problems with ambiguous probability distributions from the areas of two-stage stochastic optimization without relatively complete recourse, probability functions lacking continuity properties, expectation constraints, and outlier analysis. We are also able to circumvent the fundamental difficulty in stochastic optimization that convergence of distributions fails to guarantee convergence of expectations. The framework centers on the novel concepts of exact and limit-exact Rockafellians, with interpretations of ``negative'' regularization emerging in certain settings. We illustrate the role of Phi-divergence, examine rates of convergence under changing distributions, and explore extensions to first-order optimality conditions. The main development is free of assumptions about convexity, smoothness, and even continuity of objective functions. Numerical results in the setting of computer vision and text analytics with label noise illustrate the framework.


title: Information-theoretic Online Memory Selection for Continual Learning

abstract: A challenging problem in task-free continual learning is the online selection of a representative replay memory from data streams. In this work, we investigate the online memory selection problem from an information-theoretic perspective. To gather the most information, we propose the \textit{surprise} and the \textit{learnability} criteria to pick informative points and to avoid outliers. We present a Bayesian model to compute the criteria efficiently by exploiting rank-one matrix structures. We demonstrate that these criteria encourage selecting informative points in a greedy algorithm for online memory selection. Furthermore, by identifying the importance of \textit{the timing to update the memory}, we introduce a stochastic information-theoretic reservoir sampler (InfoRS), which conducts sampling among selective points with high information. Compared to reservoir sampling, InfoRS demonstrates improved robustness against data imbalance. Finally, empirical performances over continual learning benchmarks manifest its efficiency and efficacy.


title: V$_2$C-based lithium batteries: The influence of magnetic phase and Hubbard interaction

abstract: MXenes are a family of two-dimensional materials that could be attractive for use as electrodes in lithium batteries due to their high specific capacity. For this purpose, it is necessary to evaluate magnitudes such as the lithium adsorption energy and the magnitude of the open-circuit voltage for different lithium concentrations. In this paper, we show through first principles calculations that in a V$_2$C monolayer we must consider the high correlation between the electrons belonging to vanadium to obtain correct results of these quantities. We include this correlation employing the Hubbard coupling parameter obtained by a linear response method. We found that the system is antiferromagnetic and that the quantities studied depend on the magnetic phase considered. Indirectly, experimental results could validate the theoretical value of the theoretical Hubbard parameter.


title: Minimal Roman Dominating Functions: Extensions and Enumeration

abstract: Roman domination is one of the many variants of domination that keeps most of the complexity features of the classical domination problem. We prove that Roman domination behaves differently in two aspects: enumeration and extension. We develop non-trivial enumeration algorithms for minimal Roman domination functions with polynomial delay and polynomial space. Recall that the existence of a similar enumeration result for minimal dominating sets is open for decades. Our result is based on a polynomial-time algorithm for Extension Roman Domination: Given a graph $G = (V,E)$ and a function $f:V\to\{0,1,2\}$, is there a minimal Roman domination function $\Tilde{f}$ with $f\leq \Tilde{f}$? Here, $\leq$ lifts $0< 1< 2$ pointwise; minimality is understood in this order. Our enumeration algorithm is also analyzed from an input-sensitive viewpoint, leading to a run-time estimate of $\Oh(\RomanUpperbound^n)$ for graphs of order n; this is complemented by a lower bound example of $\Omega(\RomanLowerbound^n)$.


title: Configuration and Collection Factors for Side-Channel Disassembly

abstract: Myriad uses, methodologies, and channels have been explored for side-channel analysis. However, specific implementation considerations are often unpublished. This paper explores select test configuration and collection parameters, such as input voltage, shunt resistance, sample rate, and microcontroller clock frequency, along with their impact on side-channel analysis performance. The analysis use case considered is instruction disassembly and classification using the microcontroller power side-channel. An ATmega328P microcontroller and a subset of the AVR instruction set are used in the experiments as the Device Under Test (DUT). A time-series convolutional neural network (CNN) is used to evaluate classification performance at clock-cycle fidelity. We conclude that configuration and collection parameters have a meaningful impact on performance, especially where the instruction-trace's signal to noise ratio (SNR) is impacted. Additionally, data collection and analysis well above the Nyquist rate is required for side-channel disassembly. We also found that 7V input voltage with 1 kiloohm shunt and a sample rate of 250-500 MSa/s provided optimal performance in our application, with diminishing returns or in some cases degradation at higher levels.


title: Risk-aware UAV-UGV Rendezvous with Chance-Constrained Markov Decision Process

abstract: We study a chance-constrained variant of the cooperative aerial-ground vehicle routing problem, in which an Unmanned Aerial Vehicle (UAV) with limited battery capacity and an Unmanned Ground Vehicle (UGV) that can also act as a mobile recharging station need to jointly accomplish a mission such as monitoring a set of points. Due to the limited battery capacity of the UAV, two vehicles sometimes have to deviate from their task to rendezvous and recharge the UAV\@. Unlike prior work that has focused on the deterministic case, we address the challenge of stochastic energy consumption of the UAV\@. We are interested in finding the optimal policy that decides when and where to rendezvous such that the expected travel time of the UAV is minimized and the probability of running out of charge is less than a user-defined tolerance. We formulate this problem as a Chance Constrained Markov Decision Process (CCMDP). To the best knowledge of the authors, this is the first CMDP-based formulation for the UAV-UGV routing problems under power consumption uncertainty. We adopt a Linear Programming (LP) based approach to solve the problem optimally. We demonstrate the effectiveness of our formulation in the context of an Intelligence Surveillance and Reconnaissance (ISR) mission.


title: Analysis of Power-Oriented Fault Injection Attacks on Spiking Neural Networks

abstract: Spiking Neural Networks (SNN) are quickly gaining traction as a viable alternative to Deep Neural Networks (DNN). In comparison to DNNs, SNNs are more computationally powerful and provide superior energy efficiency. SNNs, while exciting at first appearance, contain security-sensitive assets (e.g., neuron threshold voltage) and vulnerabilities (e.g., sensitivity of classification accuracy to neuron threshold voltage change) that adversaries can exploit. We investigate global fault injection attacks by employing external power supplies and laser-induced local power glitches to corrupt crucial training parameters such as spike amplitude and neuron's membrane threshold potential on SNNs developed using common analog neurons. We also evaluate the impact of power-based attacks on individual SNN layers for 0% (i.e., no attack) to 100% (i.e., whole layer under attack). We investigate the impact of the attacks on digit classification tasks and find that in the worst-case scenario, classification accuracy is reduced by 85.65%. We also propose defenses e.g., a robust current driver design that is immune to power-oriented attacks, improved circuit sizing of neuron components to reduce/recover the adversarial accuracy degradation at the cost of negligible area and 25% power overhead. We also present a dummy neuron-based voltage fault injection detection system with 1% power and area overhead.


title: A review of knowledge graph application scenarios in cyber security

abstract: Facing the dynamic complex cyber environments, internal and external cyber threat intelligence, and the increasing risk of cyber-attack, knowledge graphs show great application potential in the cyber security area because of their capabilities in knowledge aggregation, representation, management, and reasoning. However, while most research has focused on how to develop a complete knowledge graph, it remains unclear how to apply the knowledge graph to solve industrial real challenges in cyber-attack and defense scenarios. In this review, we provide a brief overview of the basic concepts, schema, and construction approaches for the cyber security knowledge graph. To facilitate future research on cyber security knowledge graphs, we also present a curated collection of datasets and open-source libraries on the knowledge construction and information extraction task. In the major part of this article, we conduct a comparative review of the different works that elaborate on the recent progress in the application scenarios of the cyber security knowledge graph. Furthermore, a novel comprehensive classification framework is created to describe the connected works from nine primary categories and eighteen subcategories. Finally, we have a thorough outlook on several promising research directions based on the discussion of existing research flaws.


title: Singlet extensions and W boson mass in the light of the CDF II result

abstract: Recently, the CDF collaboration has reported the precise measurement of the W boson mass, $M_W = 80433.5\pm 9.4 \,$MeV, based on $8.8$ fb$^{-1}$ of $\sqrt{s}=1.96$ TeV $p\bar{p}$ collision data from the CDF II detector at the Fermilab Tevatron. This is about $7\sigma$ away from the Standard Model prediction, $M_{W}^{\rm SM}=80357 \pm 6 \,$MeV. Such a large discrepancy may be partially due to exotic particles that radiatively alter the relation between the W and Z boson masses. In this Letter, we study singlet extensions of the Standard Model focusing on the shift of the W boson mass. In the minimal extension with a real singlet field, using the bounds from the electroweak oblique parameters, B meson decays, LEP, and LHC, we find that the W boson mass shift is at most a few MeV, and therefore it does not alleviate the tension between the CDF II result and the SM prediction. We then examine how much various bounds are relaxed when the singlet is allowed to decay invisibly and find that the increase of the W boson mass does not exceed $5$ MeV due to the bound from the Higgs signal strength. We also discuss phenomenological and cosmological implications of the singlet extensions such as the muon $g-2$ anomaly, axion/hidden photon dark matter, and self-interacting dark radiation as a possible alleviation of the Hubble tension.


title: Image Reconstruction for MRI using Deep CNN Priors Trained without Groundtruth

abstract: We propose a new plug-and-play priors (PnP) based MR image reconstruction method that systematically enforces data consistency while also exploiting deep-learning priors. Our prior is specified through a convolutional neural network (CNN) trained without any artifact-free ground truth to remove undersampling artifacts from MR images. The results on reconstructing free-breathing MRI data into ten respiratory phases show that the method can form high-quality 4D images from severely undersampled measurements corresponding to acquisitions of about 1 and 2 minutes in length. The results also highlight the competitive performance of the method compared to several popular alternatives, including the TGV regularization and traditional UNet3D.