title: Approximating a flexible beam model in the Loewner framework

abstract: The paper develops the Loewner approach for data-based modeling of a linear distributed-parameter system. This approach is applied to a controlled flexible beam model coupled with a spring-mass system. The original dynamical system is described by the Euler-Bernoulli partial differential equation with the interface conditions due to the oscillations of the lumped part. The transfer function of this model is computed analytically, and its sampled values are then used for the data-driven design of a reduced model. A family of approximate realizations of the corresponding input-output map is constructed within the Loewner framework. It is shown that the proposed finite-dimensional approximations are able to capture the key properties of the original dynamics over a given range of observed frequencies. The robustness of the method to noisy data is also investigated.


title: Information causality in multipartite scenarios

abstract: Bell nonlocality is one of the most intriguing and counter-intuitive phenomena displayed by quantum systems. Interestingly, such stronger-than-classical quantum correlations are somehow constrained, and one important question to the foundations of quantum theory is whether there is a physical, operational principle responsible for those constraints. One candidate is the information causality principle, which, in some particular cases, is proven to hold for quantum systems and to be violated by stronger-than-quantum correlations. In multipartite scenarios, though, it is known that the original formulation of the information causality principle fails to detect even extremal stronger-than-quantum correlations, thus suggesting that a genuinely multipartite formulation of the principle is necessary. In this work, we advance towards this goal, reporting a new formulation of the information causality principle in multipartite scenarios. By proposing a change of perspective, we obtain multipartite informational inequalities that work as necessary criteria for the principle to hold. We prove that such inequalities hold for all quantum resources, and forbid some stronger-than-quantum ones. Finally, we show that our approach can be strengthened if multiple copies of the resource are available, or, counter-intuitively, if noisy communication channels are employed.


title: ResFed: Communication Efficient Federated Learning by Transmitting Deep Compressed Residuals

abstract: Federated learning enables cooperative training among massively distributed clients by sharing their learned local model parameters. However, with increasing model size, deploying federated learning requires a large communication bandwidth, which limits its deployment in wireless networks. To address this bottleneck, we introduce a residual-based federated learning framework (ResFed), where residuals rather than model parameters are transmitted in communication networks for training. In particular, we integrate two pairs of shared predictors for the model prediction in both server-to-client and client-to-server communication. By employing a common prediction rule, both locally and globally updated models are always fully recoverable in clients and the server. We highlight that the residuals only indicate the quasi-update of a model in a single inter-round, and hence contain more dense information and have a lower entropy than the model, comparing to model weights and gradients. Based on this property, we further conduct lossy compression of the residuals by sparsification and quantization and encode them for efficient communication. The experimental evaluation shows that our ResFed needs remarkably less communication costs and achieves better accuracy by leveraging less sensitive residuals, compared to standard federated learning. For instance, to train a 4.08 MB CNN model on CIFAR-10 with 10 clients under non-independent and identically distributed (Non-IID) setting, our approach achieves a compression ratio over 700X in each communication round with minimum impact on the accuracy. To reach an accuracy of 70%, it saves around 99% of the total communication volume from 587.61 Mb to 6.79 Mb in up-streaming and to 4.61 Mb in down-streaming on average for all clients.


title: Error-aware Quantization through Noise Tempering

abstract: Quantization has become a predominant approach for model compression, enabling deployment of large models trained on GPUs onto smaller form-factor devices for inference. Quantization-aware training (QAT) optimizes model parameters with respect to the end task while simulating quantization error, leading to better performance than post-training quantization. Approximation of gradients through the non-differentiable quantization operator is typically achieved using the straight-through estimator (STE) or additive noise. However, STE-based methods suffer from instability due to biased gradients, whereas existing noise-based methods cannot reduce the resulting variance. In this work, we incorporate exponentially decaying quantization-error-aware noise together with a learnable scale of task loss gradient to approximate the effect of a quantization operator. We show this method combines gradient scale and quantization noise in a better optimized way, providing finer-grained estimation of gradients at each weight and activation layer's quantizer bin size. Our controlled noise also contains an implicit curvature term that could encourage flatter minima, which we show is indeed the case in our experiments. Experiments training ResNet architectures on the CIFAR-10, CIFAR-100 and ImageNet benchmarks show that our method obtains state-of-the-art top-1 classification accuracy for uniform (non mixed-precision) quantization, out-performing previous methods by 0.5-1.2% absolute.


title: For optical flickering in symbiotic star MWC 560

abstract: This study is based on observations of MWC560 during the last two observational seasons (2020/2021 and 2021/2022). Other than looking for flickering we were interested in following the variability of brightness in the same period. Looking for similarities in the spectra with other types of stars is also of great interest to us because it could help clarify the stellar configuration of such objects. Our observations during the last two observational seasons of MWC560 confirm the absence of flickering. From the similarities of the gathered spectra of XX Oph and MWC560 we assume that the components in XX Oph are a red giant and a white dwarf, which are also surrounded by a common shell.


title: Dark Energy Nature in Logarithmic $f(R,T)$ Cosmology

abstract: The present research paper is an investigation of dark energy nature of logarithmic $f(R, T)$-gravity cosmology in a flat FLRW space-time universe. We have derived modified Einstein's field equations for the function $f(R, T)=R-16\pi G\alpha\ln(T)$ where $R$ is the Ricci scalar curvature, $T$ is the trace of the stress energy momentum tensor and $\alpha$ is a model parameter. We have solved field equations in the form of two fluid scenario as perfect-fluid and dark-fluid, where dark fluid term is derived in the form of perfect fluid source. We have made an observational constraints on the cosmological parameters $\Omega_{(m)}, \omega^{(de)}$ and $H_{0}$ using $\chi^{2}$ test with observational datasets like Pantheon sample of SNe Ia and $H(z)$. With these constraints we have discussed our model with deceleration parameter $q$, energy parameters $\Omega_{(m)}, \Omega_{(de)}$, EoS parameter $\omega^{(de)}$ etc. Also, we have done Om diagnostic analysis. The derived $f(R, T)$ model shows a quintessence dark energy model $\omega^{(de)}>-1$ and late-time universe approaches to $\Lambda$CDM model.


title: Transductive Linear Probing: A Novel Framework for Few-Shot Node Classification

abstract: Few-shot node classification is tasked to provide accurate predictions for nodes from novel classes with only few representative labeled nodes. This problem has drawn tremendous attention for its projection to prevailing real-world applications, such as product categorization for newly added commodity categories on an E-commerce platform with scarce records or diagnoses for rare diseases on a patient similarity graph. To tackle such challenging label scarcity issues in the non-Euclidean graph domain, meta-learning has become a successful and predominant paradigm. More recently, inspired by the development of graph self-supervised learning, transferring pretrained node embeddings for few-shot node classification could be a promising alternative to meta-learning but remains unexposed. In this work, we empirically demonstrate the potential of an alternative framework, \textit{Transductive Linear Probing}, that transfers pretrained node embeddings, which are learned from graph contrastive learning methods. We further extend the setting of few-shot node classification from standard fully supervised to a more realistic self-supervised setting, where meta-learning methods cannot be easily deployed due to the shortage of supervision from training classes. Surprisingly, even without any ground-truth labels, transductive linear probing with self-supervised graph contrastive pretraining can outperform the state-of-the-art fully supervised meta-learning based methods under the same protocol. We hope this work can shed new light on few-shot node classification problems and foster future research on learning from scarcely labeled instances on graphs.


title: An overview of maximal distance minimizers problem

abstract: Consider a compact $M \subset \mathbb{R}^d$ and $l > 0$. A maximal distance minimizer problem is to find a connected compact set $\Sigma$ of the length (one-dimensional Hausdorff measure $\H$) at most $l$ that minimizes \[ \max_{y \in M} dist (y, \Sigma), \] where $dist$ stands for the Euclidean distance. We give a survey on the results on the maximal distance minimizers and related problems.


title: A novel high-current, high-resolution, low-kinetic-energy electron source for inverse photoemission spectroscopy

abstract: A high-current electron source for inverse photoemission spectroscopy (IPES) is described. The source comprises a thermal cathode electron emission system, an electrostatic deflector-monochromator, and a lens system for variable kinetic energy (1.6 - 20 eV) at the target. When scaled to the energy resolution, the electron current is an order of magnitude higher than that of previously described electron sources developed in the context of electron energy loss spectroscopy. Surprisingly, the experimentally measured energy resolution turned out to be significantly better than calculated by standard programs, which include the electron-electron repulsion in the continuum approximation. The achieved currents are also significantly higher than predicted. We attribute this "inverse Boersch-effect" to a mechanism of velocity selection in the forward direction by binary electron-electron collisions.


title: A Bit Stream Feature-Based Energy Estimator for HEVC Software Encoding

abstract: The total energy consumption of today's video coding systems is globally significant and emphasizes the need for sustainable video coder applications. To develop such sustainable video coders, the knowledge of the energy consumption of state-of-the-art video coders is necessary. For that purpose, we need a dedicated setup that measures the energy of the encoding and decoding system. However, such measurements are costly and laborious. To this end, this paper presents an energy estimator that uses a subset of bit stream features to accurately estimate the energy consumption of the HEVC software encoding process. The proposed model reaches a mean estimation error of 4.88% when averaged over presets of the x265 encoder implementation. The results from this work help to identify properties of encoding energy-saving bit streams and, in turn, are useful for developing new energy-efficient video coding algorithms.


title: Authorship Identification of Source Code Segments Written by Multiple Authors Using Stacking Ensemble Method

abstract: Source code segment authorship identification is the task of identifying the author of a source code segment through supervised learning. It has vast importance in plagiarism detection, digital forensics, and several other law enforcement issues. However, when a source code segment is written by multiple authors, typical author identification methods no longer work. Here, an author identification technique, capable of predicting the authorship of source code segments, even in the case of multiple authors, has been proposed which uses a stacking ensemble classifier. This proposed technique is built upon several deep neural networks, random forests and support vector machine classifiers. It has been shown that for identifying the author group, a single classification technique is no longer sufficient and using a deep neural network-based stacking ensemble method can enhance the accuracy significantly. The performance of the proposed technique has been compared with some existing methods which only deal with the source code segments written precisely by a single author. Despite the harder task of authorship identification for source code segments written by multiple authors, our proposed technique has achieved promising results evidenced by the identification accuracy, compared to the related works which only deal with code segments written by a single author.


title: Accelerating Self-Supervised Learning via Efficient Training Strategies

abstract: Recently the focus of the computer vision community has shifted from expensive supervised learning towards self-supervised learning of visual representations. While the performance gap between supervised and self-supervised has been narrowing, the time for training self-supervised deep networks remains an order of magnitude larger than its supervised counterparts, which hinders progress, imposes carbon cost, and limits societal benefits to institutions with substantial resources. Motivated by these issues, this paper investigates reducing the training time of recent self-supervised methods by various model-agnostic strategies that have not been used for this problem. In particular, we study three strategies: an extendable cyclic learning rate schedule, a matching progressive augmentation magnitude and image resolutions schedule, and a hard positive mining strategy based on augmentation difficulty. We show that all three methods combined lead up to 2.7 times speed-up in the training time of several self-supervised methods while retaining comparable performance to the standard self-supervised learning setting.


title: Multimodal and Explainable Internet Meme Classification

abstract: In the current context where online platforms have been effectively weaponized in a variety of geo-political events and social issues, Internet memes make fair content moderation at scale even more difficult. Existing work on meme classification and tracking has focused on black-box methods that do not explicitly consider the semantics of the memes or the context of their creation. In this paper, we pursue a modular and explainable architecture for Internet meme understanding. We design and implement multimodal classification methods that perform example- and prototype-based reasoning over training cases, while leveraging both textual and visual SOTA models to represent the individual cases. We study the relevance of our modular and explainable models in detecting harmful memes on two existing tasks: Hate Speech Detection and Misogyny Classification. We compare the performance between example- and prototype-based methods, and between text, vision, and multimodal models, across different categories of harmfulness (e.g., stereotype and objectification). We devise a user-friendly interface that facilitates the comparative analysis of examples retrieved by all of our models for any given meme, informing the community about the strengths and limitations of these explainable methods.


title: A Study of Slang Representation Methods

abstract: Considering the large amount of content created online by the minute, slang-aware automatic tools are critically needed to promote social good, and assist policymakers and moderators in restricting the spread of offensive language, abuse, and hate speech. Despite the success of large language models and the spontaneous emergence of slang dictionaries, it is unclear how far their combination goes in terms of slang understanding for downstream social good tasks. In this paper, we provide a framework to study different combinations of representation learning models and knowledge resources for a variety of downstream tasks that rely on slang understanding. Our experiments show the superiority of models that have been pre-trained on social media data, while the impact of dictionaries is positive only for static word embeddings. Our error analysis identifies core challenges for slang representation learning, including out-of-vocabulary words, polysemy, variance, and annotation disagreements, which can be traced to characteristics of slang as a quickly evolving and highly subjective language.


title: Generic Tagging for RISC-V Binaries

abstract: With the widespread popularity of RISC-V -- an open-source ISA -- custom hardware security solutions targeting specific defense needs are gaining popularity. These solutions often require specialized compilers that can insert metadata (called tags) into the generated binaries, and/or extend the RISC-V ISA with new instructions. Developing such compilers can be a tedious and time-consuming process. In this paper, we present COGENT, a generic instruction tag generator for RISC-V architecture. COGENT is capable of associating a tag of configurable and varying widths (1 to 20 bits) to each instruction. It is also capable of emitting labels that are central to the implementation of control-flow integrity (CFI) solutions. COGENT encodes all tags and labels as nop instructions thereby providing full backward compatibility. We evaluate COGENT on a subset of programs from the SPEC CPU2017 benchmark suite and report the binary size increase to be 29.3% and 18.27% for the lowest and highest tag coverage levels respectively. Additionally, we executed tagged programs on COTS RISC-V unmodified hardware and found the execution time overhead (with respect to backward compatibility) to be 13.4% and 5.72% for the lowest and highest coverage levels respectively. Finally, using a case study, we present possible use case scenarios where COGENT can be applied.


title: Intrinsic control of interlayer exciton generation rate in van der Waals materials via Janus layers

abstract: We demonstrate the possibility of engineering the optical properties of transition metal dichalcogenide heterobilayers when one of the constitutive layers has a Janus structure. This has important consequences for the charge separation efficiency. We investigate different MoS$_2$@Janus layer combinations using first-principles methods including electron-hole interactions (excitons) and exciton-phonon coupling. The direction of the intrinsic electric field from the Janus layer modifies the electronic band alignments and, consequently, the energy separation between interlayer exciton states -- which usually have a very low oscillator strength and hence are almost dark in absorption -- and bright in-plane excitons. We find that in-plane lattice vibrations strongly couple the two states, so that exciton-phonon scattering may be a viable generation mechanism for interlayer excitons upon light absorption. In particular, in the case of MoS$_2$@WSSe, the energy separation of the low-lying interlayer exciton from the in-plane exciton is resonant with the transverse optical phonon modes (40 meV). We thus identify this heterobilayer as a prime candidate for efficient electron-hole pair generation with efficient charge carrier separation.


title: Deep Inelastic Scattering with Application to Nuclear Targets: Lectures at the 1985 Los Alamos School on Relativistic Dynamics and Quark Nuclear Physics

abstract: This paper is essentially a verbatim reconstruction of lectures that I gave at the Los Alamos School on Relativistic Dynamics and Quark Nuclear Physics in 1985. They were published in the school proceedings, but the book is not widely available. The Los Alamos School took place at the height of the first wave of interest in the quark substructure of nuclei, stimulated by the 1983 discovery of the EMC Effect. Interest in this subject has been increasing for years and the prospect of a dedicated Electron Ion Collider within the decade guarantees even greater attention to quarks and gluons in nuclei among both theorists and experimentalists. Recently, to my surprise, I learned that copies of my old lectures have been circulating and been found useful by the relatively few people who know about them. The are, of course, dated: experiments have far outstripped what was available 37 years ago and theory has progressed too. However, the rest frame derivation of the parton model, the derivation and discussion of the convolution formalism for nucleons, nucleon correlations, and other, virtual, constituents of nuclei, and sections on scaling violation and the operator product expansion have aged pretty well and seem to still be useful. With the help and encouragement of Richard Milner, I have recreated the LaTeX files necessary to post the 1985 Lectures on the arXiv, making them available to the nuclear and particle physics community. Apart from correcting some typographical errors, I have made no attempt to edit, improve, or update these lectures. I hope readers will nevertheless find them useful.


title: Decomposition of the Leinster-Cobbold Diversity Index

abstract: The Leinster and Cobbold diversity index possesses a number of merits; in particular, it generalises many existing indices and defines an effective number. We present a scheme to quantify the contribution of richness, evenness, and taxonomic similarity to this index. Compared to the work of van Dam (2019), our approach gives unbiased estimates of both evenness and similarity in a non-homogeneous community. We also introduce a notion of taxonomic tree equilibration which should be of use in the description of community structure.


title: Robustness of travelling states in generic non-reciprocal mixtures

abstract: Emergent non-reciprocal interactions violating Newton's third law are widespread in out-of-equilibrium systems. It has been demonstrated recently that phase separating mixtures with such non-reciprocal interactions between components exhibit travelling states that have no equilibrium counterpart. Using extensive Brownian dynamics simulations, we investigate the existence and stability of such travelling states in the collective dynamics of a generic non-reciprocal particle system. By varying a broad range of parameters including aggregate state of the mixture components, diffusivity, degree of non-reciprocity, effective spatial dimension and density, we determine that these dynamic travelling states exist only in a relatively narrow region of parameter space. Our work also sheds light on the physical mechanisms for the disappearance of travelling states when relevant parameters are being varied. Our results have implications for a range of non-equilibrium systems including non-reciprocal phase separating mixtures, non-equilibrium pattern formation and predator-prey models.


title: Algorithms approaching the threshold for semi-random planted clique

abstract: We design new polynomial-time algorithms for recovering planted cliques in the semi-random graph model introduced by Feige and Kilian 2001. The previous best algorithms for this model succeed if the planted clique has size at least $n^{2/3}$ in a graph with $n$ vertices (Mehta, Mckenzie, Trevisan 2019 and Charikar, Steinhardt, Valiant 2017). Our algorithms work for planted-clique sizes approaching $n^{1/2}$ -- the information-theoretic threshold in the semi-random model (Steinhardt 2017) and a conjectured computational threshold even in the easier fully-random model. This result comes close to resolving open questions by Feige 2019 and Steinhardt 2017. Our algorithms are based on higher constant degree sum-of-squares relaxation and rely on a new conceptual connection that translates certificates of upper bounds on biclique numbers in unbalanced bipartite Erd\H{o}s--R\'enyi random graphs into algorithms for semi-random planted clique. The use of a higher-constant degree sum-of-squares is essential in our setting: we prove a lower bound on the basic SDP for certifying bicliques that shows that the basic SDP cannot succeed for planted cliques of size $k =o(n^{2/3})$. We also provide some evidence that the information-computation trade-off of our current algorithms may be inherent by proving an average-case lower bound for unbalanced bicliques in the low-degree-polynomials model.


title: Stability of the Catenoid for the Hyperbolic Vanishing Mean Curvature Equation Outside Symmetry

abstract: We study the problem of stability of the catenoid, which is an asymptotically flat rotationally symmetric minimal surface in Euclidean space, viewed as a stationary solution to the hyperbolic vanishing mean curvature equation in Minkowski space. The latter is a quasilinear wave equation that constitutes the hyperbolic counterpart of the minimal surface equation in Euclidean space. Our main result is the nonlinear asymptotic stability, modulo suitable translation and boost (i.e., modulation), of the $n$-dimensional catenoid with respect to a codimension one set of initial data perturbations without any symmetry assumptions, for $n \geq 5$. The modulation and the codimension one restriction on the data are necessary and optimal in view of the kernel and the unique simple eigenvalue, respectively, of the stability operator of the catenoid. In a broader context, this paper fits in the long tradition of studies of soliton stability problems. From this viewpoint, our aim here is to tackle some new issues that arise due to the quasilinear nature of the underlying hyperbolic equation. Ideas introduced in this paper include a new profile construction and modulation analysis to track the evolution of the translation and boost parameters of the stationary solution, a new scheme for proving integrated local energy decay for the perturbation in the quasilinear and modulation-theoretic context, and an adaptation of the vectorfield method in the presence of dynamic translations and boosts of the stationary solution.


title: Dirac gauge theory for topological spinors in 3+1 dimensional networks

abstract: Gauge theories on graphs and networks are attracting increasing attention not only as approaches to quantum gravity but also as models for performing quantum computation. Here we propose a Dirac gauge theory for topological spinors in $3+1$ dimensional networks associated to an arbitrary metric. Topological spinors are the direct sum of $0$-cochains and $1$-cochains defined on a network and describe a matter field defined on both nodes and links of a network. Recently in Ref. \cite{bianconi2021topological} it has been shown that topological spinors obey the topological Dirac equation driven by the discrete Dirac operator. In this work we extend these results by formulating the Dirac equation on weighted and directed $3+1$ dimensional networks which allow for the treatment of a local theory. The commutators and anti-commutators of the Dirac operators are non vanishing an they define the curvature tensor and magnetic field of our theory respectively. This interpretation is confirmed by the non-relativistic limit of the proposed Dirac equation. In the non-relativistic limit of the proposed Dirac equation the sector of the spinor defined on links follows the Schr\"odinger equation with the correct giromagnetic moment, while the sector of the spinor defined on nodes follows the Klein-Gordon equation and is not negligible. The action associated to the proposed field theory comprises of a Dirac action and a metric action. We describe the gauge invariance of the action under both Abelian and non-Abelian transformations and we propose the equation of motion of the field theory of both Dirac and metric fields. This theory can be interpreted as a limiting case of a more general gauge theory valid on any arbitrary network in the limit of almost flat spaces.

categories: cond-mat.dis-nn cond-mat.stat-mech gr-qc hep-lat quant-ph


title: Estimation of the photon production rate using imaginary momentum correlators

abstract: The thermal photon emission rate is determined by the spatially transverse, in-medium spectral function of the electromagnetic current. Accessing the spectral function using Euclidean data is, however, a challenging problem due to the ill-posed nature of inverting the Laplace transform. In this contribution, we present the first results on implementing the proposal of directly computing the analytic continuation of the retarded correlator at fixed, vanishing virtuality of the photon via the calculation of the appropriate Euclidean correlator at imaginary spatial momentum. We employ two dynamical O(a)-improved Wilson fermions at a temperature of 250 MeV.


title: Global existence for coupled reaction-diffusion equations with a balance law and nonlinearities with non-constant sign

abstract: This paper aims to prove the global existence of solutions for coupled reaction diffusion equations with a balance Law and nonlinearities with a non constant sign. The case when one (or both) of the components of the solution is not a priori bounded is treated. Proofs are based on developed Lyapunov techniques.


title: Local Volume dwarf KK242: radial velocity, SF region, and metallicity

abstract: KK242 is a LV dwarf of transition type residing in the void environment. Koda et al. present clear indications on its connection with Scd galaxy NGC6503. This implies the distance to KK242 of ~6.3 Mpc and its M_B = -10.5 mag. Its radial velocity, known from the Effelsberg radio telescope \HI\ observations, reveals, however, the difference with that of NGC6503, dV ~ 400 km/s. If real, this fact implies the substantial constraints on its origin. To clear-up the issue of KK242 radial velocity, we obtained with the SAO 6-m telescope spectra of its faint star-forming (SF) complex. H-alpha and H-beta emission is detected in two adjacent compact regions, the southern and northern, separated by ~2" (~60 pc). Their mean radial velocity is V_hel = -66 km/s, ~100 km/s lower than that of NGC6503. We use the HST Legacy Archive images and photometry of individual stars from the Extragalactic Distance Database, available for KK242, to identify in the SF complex the exciting hot stars, the probable BHeB and RHeB stars and a supernova remnant. We address, based on the possible range of its gas metallicity, the probable evolutionary paths of KK242. Using package Cloudy and parameters of the exciting B0V stars, we conclude that the observed flux ratio of [Sii] doublet to H-alpha is consistent with the value of 12+log(O/H) ~7.35+/-0.18 dex, expected for a stripped void dIrr galaxy.


title: Current-voltage characteristics of superconductor-normal metal-superconductor junctions

abstract: We develop a theory of current-voltage (I-U) characteristics for superconductor-normal metal-superconductor (SNS) junctions. At small voltages and sufficiently low temperatures the I-U characteristics of the junction is controlled by the inelastic relaxation time, \tau_{in}. In particular, the linear conductance is proportional to, \tau_{in}. In this regime the I-U characteristics can be expressed solely in terms of dependence of the density of states in the normal region, \nu(\chi), on the phase difference of the order parameter across the the junction. In contrast, at large voltages the I-U characteristics of the device is controlled by the elastic relaxation time, \tau_{el}, which is much smaller than the inelastic one.


title: Human-Robot Team Performance Compared to Full Robot Autonomy in 16 Real-World Search and Rescue Missions: Adaptation of the DARPA Subterranean Challenge

abstract: Human operators in human-robot teams are commonly perceived to be critical for mission success. To explore the direct and perceived impact of operator input on task success and team performance, 16 real-world missions (10 hrs) were conducted based on the DARPA Subterranean Challenge. These missions were to deploy a heterogeneous team of robots for a search task to locate and identify artifacts such as climbing rope, drills and mannequins representing human survivors. Two conditions were evaluated: human operators that could control the robot team with state-of-the-art autonomy (Human-Robot Team) compared to autonomous missions without human operator input (Robot-Autonomy). Human-Robot Teams were often in directed autonomy mode (70% of mission time), found more items, traversed more distance, covered more unique ground, and had a higher time between safety-related events. Human-Robot Teams were faster at finding the first artifact, but slower to respond to information from the robot team. In routine conditions, scores were comparable for artifacts, distance, and coverage. Reasons for intervention included creating waypoints to prioritise high-yield areas, and to navigate through error-prone spaces. After observing robot autonomy, operators reported increases in robot competency and trust, but that robot behaviour was not always transparent and understandable, even after high mission performance.


title: Virial expansion for the optical response of doped two-dimensional semiconductors

abstract: We present a quantum virial expansion for the optical response of a doped two-dimensional semiconductor. As we show, this constitutes a perturbatively exact theory in the high-temperature or low-doping regime, where the electrons' thermal wavelength is smaller than their interparticle spacing. The virial expansion predicts new features of the photoluminescence, such as a non-trivial shape of the attractive branch related to universal low-energy exciton-electron scattering and an associated shift of the attractive peak from the trion energy. Our results are in excellent agreement with recent experiments on doped monolayer MoSe2 [Zipfel et al., Phys. Rev. B 105, 075311 (2022)] and they imply that the trion binding energy is likely to have been overestimated in previous measurements. Our theory furthermore allows us to formally unify two distinct theoretical pictures that have been applied to this system, with the conventional trion picture results emerging as a high-temperature and weak-interaction limit of Fermi polaron theory.


title: Studying Postmerger Outflows from Magnetized Neutrino-cooled Accretion Disks

abstract: Neutrino-cooled accretion flow around a spinning black hole, produced by a compact binary merger is a promising scenario for jet formation and launching magnetically-driven outflows. Based on GW170817 gravitational wave detection by LIGO and Virgo observatories followed by electromagnetic counterparts, this model can explain the central engine of the short duration gamma ray bursts (GRB) and kilonova radiations. Using the open-source GRMHD HARM-COOL code, we evolved several 2D magnetized accretion disk-black hole models with realistic equation of state in the fixed curved space-time background. We applied particle tracer technique to measure the properties of the outflows. The disk and black hole's initial parameters are chosen in a way to represent different possible post-merger scenarios of the merging compact objects. Our simulations show a strong correlation between black hole's spin and ejected mass. Generally, mergers producing massive disks and rapidly spinning black holes launch stronger outflows. We observed our models generate winds with moderate velocity ($v/c \sim 0.1-0.2$), and broad range of electron fraction. We use these results to estimate the luminosity and light curves of possible radioactively powered transients emitted by such systems. We found the luminosity peaks within the range of $10^{40}-10^{42}$ erg/s which agrees with previous studies for disk wind outflows.


title: Field redefinition invariant Lagrange multiplier formalism

abstract: In this paper, we propose a field redefinition invariant Lagrange multiplier (LM) formalism in which new ghost-like fields, analogous to Lee-Yang ghosts, are introduced. These ghost fields are required to restore the field redefinition invariance of the standard path integral of the LM theory and, at the same time, to cancel the additional contributions due to the LM fields. We argue that the extra degrees of freedom in the standard LM formalism, coming from the LM fields, should cancel against the degrees of freedom of the ghost fields. Hence, in the field redefinition invariant formalism the doubling of degrees of freedom, associated with the LM fields, is absent.


title: DISCO: Adversarial Defense with Local Implicit Functions

abstract: The problem of adversarial defenses for image classification, where the goal is to robustify a classifier against adversarial examples, is considered. Inspired by the hypothesis that these examples lie beyond the natural image manifold, a novel aDversarIal defenSe with local impliCit functiOns (DISCO) is proposed to remove adversarial perturbations by localized manifold projections. DISCO consumes an adversarial image and a query pixel location and outputs a clean RGB value at the location. It is implemented with an encoder and a local implicit module, where the former produces per-pixel deep features and the latter uses the features in the neighborhood of query pixel for predicting the clean RGB value. Extensive experiments demonstrate that both DISCO and its cascade version outperform prior defenses, regardless of whether the defense is known to the attacker. DISCO is also shown to be data and parameter efficient and to mount defenses that transfers across datasets, classifiers and attacks.


title: Morphology of Shocked Lateral Outflows in Colliding Hydrodynamic Flows

abstract: Supersonic interacting flows occurring in phenomena such as protostellar jets give rise to strong shocks, and have been demonstrated in several laboratory experiments. To study such colliding flows, we use the AstroBEAR AMR code to conduct hydrodynamic simulations in three dimensions. We introduce variations in the flow parameters of density, velocity, and cross sectional radius of the colliding flows %radius in order to study the propagation and conical shape of the bow shock formed by collisions between two, not necessarily symmetric, hypersonic flows. We find that the motion of the interaction region is driven by imbalances in ram pressure between the two flows, while the conical structure of the bow shock is a result of shocked lateral outflows (SLOs) being deflected from the horizontal when the flows are of differing cross-section.


title: Blockchain Network Analysis: A Comparative Study of Decentralized Banks

abstract: Decentralized finance (DeFi) is known for its unique mechanism design, which applies smart contracts to facilitate peer-to-peer transactions. The decentralized bank is a typical DeFi application. Ideally, a decentralized bank should be decentralized in the transaction. However, many recent studies have found that decentralized banks have not achieved a significant degree of decentralization. This research conducts a comparative study among mainstream decentralized banks. We apply core-periphery network features analysis using the transaction data from four decentralized banks, Liquity, Aave, MakerDao, and Compound. We extract six features and compare the banks' levels of decentralization cross-sectionally. According to the analysis results, we find that: 1) MakerDao and Compound are more decentralized in the transactions than Aave and Liquity. 2) Although decentralized banking transactions are supposed to be decentralized, the data show that four banks have primary external transaction core addresses such as Huobi, Coinbase, and Binance, etc. We also discuss four design features that might affect network decentralization. Our research contributes to the literature at the interface of decentralized finance, financial technology (Fintech), and social network analysis and inspires future protocol designs to live up to the promise of decentralized finance for a truly peer-to-peer transaction network.

categories: econ.GN cs.CR cs.SI q-fin.EC q-fin.TR stat.CO


title: Clustered Formation of Massive Stars within an Ionized Rotating Disk

abstract: We present ALMA observations with a 800 au resolution and radiative-transfer modelling of the inner part ($r\approx6000$ au) of the ionized accretion flow around a compact star cluster in formation at the center of the luminous ultra-compact (UC) HII region G10.6-0.4. We modeled the flow with an ionized Keplerian disk with and without radial motions in its outer part, or with an external Ulrich envelope. The MCMC fits to the data give total stellar masses $M_\star$ from 120 to $200~M_\odot$, with much smaller ionized-gas masses $M_\mathrm{ion-gas} = 0.2$ to $0.25~M_\odot$. The stellar mass is distributed within the gravitational radius $R_g\approx 1000$ to 1500 au, where the ionized gas is bound. The viewing inclination angle from the face-on orientation is $i = 49$ to $56~\deg$. Radial motions at radii $r > R_g$ converge to $v_{r,0} \approx 8.7$ km/s, or about the speed of sound of ionized gas, indicating that this gas is marginally unbound at most. From additional constraints on the ionizing-photon rate and far-IR luminosity of the region, we conclude that the stellar cluster consists of a few massive stars with $M_\mathrm{star} = 32$ to $60~M_\odot$, or one star in this range of masses accompanied by a population of lower-mass stars. Any active accretion of ionized gas onto the massive (proto)stars is residual. The inferred cluster density is very large, comparable to that reported at similar scales in the Galactic Center. Stellar interactions are likely to occur within the next Myr.


title: Elliptically symmetric distributions for directional data of arbitrary dimension

abstract: We formulate a class of angular Gaussian distributions that allows different degrees of isotropy for directional random variables of arbitrary dimension. Through a series of novel reparameterization, this distribution family is indexed by parameters with meaningful statistical interpretations that can range over the entire real space of an adequate dimension. The new parameterization greatly simplifies maximum likelihood estimation of all model parameters, which in turn leads to theoretically sound and numerically stable inference procedures to infer key features of the distribution. Byproducts from the likelihood-based inference are used to develop graphical and numerical diagnostic tools for assessing goodness of fit of this distribution in a data application. Simulation study and application to data from a hydrogeology study are used to demonstrate implementation and performance of the inference procedures and diagnostics methods.


title: Crossover from exciton polarons to trions in doped two-dimensional semiconductors at finite temperature

abstract: We study systematically the role of temperature in the optical response of doped two-dimensional semiconductors. By making use of a finite-temperature Fermi-polaron theory, we reveal a crossover from a quantum-degenerate regime with well-defined polaron quasiparticles to an incoherent regime at high temperature or low doping where the lowest energy "attractive" polaron quasiparticle is destroyed, becoming subsumed into a broad trion-hole continuum. We demonstrate that the crossover is accompanied by significant qualitative changes in both absorption and photoluminescence. In particular, with increasing temperature (or decreasing doping), the emission profile of the attractive branch evolves from a symmetric Lorentzian to an asymmetric peak with an exponential tail involving trions and recoil electrons at finite momentum. We discuss the effect of temperature on the coupling to light for structures embedded into a microcavity, and we show that there can exist well-defined polariton quasiparticles even when the exciton-polaron quasiparticle has been destroyed, where the transition from weak to strong light-matter coupling can be explained in terms of the polaron linewidths and spectral weights.


title: Plasmonic and metamaterial biosensors: A game-changer for virus detection

abstract: One of the most important processes in the fight against current and future pandemics is the rapid diagnosis and initiation of treatment of viruses in humans. In these times, the development of high-sensitivity tests and diagnostic kits is an important research area. Plasmonic platforms, which control light in subwavelength volumes, have opened up exciting prospects for biosensing applications. Their significant sensitivity and selectivity allow for the non-invasive and rapid detection of viruses. In particular, plasmonic-assisted virus detection platforms can be achieved by various approaches, including propagating surface and localized plasmon resonances, as well as surface-enhanced Raman spectroscopy. In this review, we discuss both the fundamental principles governing a plasmonic biosensor and prospects for achieving improved sensor performance. We highlight several nanostructure schemes to combat virus-related diseases. We also examine technological limitations and challenges of plasmonic-based biosensing, such as reducing the overall cost and handling of complex biological samples. Finally, we provide a future prospective for opportunities to improve plasmonic-based approaches to increase their impact on global health issues.


title: Von Neumann algebra description of inflationary cosmology

abstract: We study the von Neumann algebra description of the inflationary quasi-de Sitter (dS) space. Unlike perfect dS space, quasi-dS space allows the nonzero energy flux across the horizon, which can be identified with the expectation value of the static time translation generator. Moreover, as a dS isometry associated with the static time translation is spontaneously broken, the fluctuation in time is accumulated, which induces the fluctuation in the energy flux. When the inflationary period is given by $(\epsilon_H H)^{-1}$ where $\epsilon_H$ is the slow-roll parameter measuring the increasing rate of the Hubble radius, both the energy flux and its fluctuation diverge in the $G \to 0$ limit. Taking the fluctuation in the energy flux and that in the observer's energy into account, we argue that the inflationary quasi-dS space is described by Type II$_\infty$ algebra. As the entropy is not bounded from above, this is different from Type II$_1$ description of perfect dS space in which the entropy is maximized by the maximal entanglement. We also show that our result is consistent with the observation that the von Neumann entropy for the density matrix reflecting the fluctuations above is interpreted as the generalized entropy.


title: Cross-Modal Learning with 3D Deformable Attention for Action Recognition

abstract: An important challenge in vision-based action recognition is the embedding of spatiotemporal features with two or more heterogeneous modalities into a single feature. In this study, we propose a new 3D deformable transformer for action recognition with adaptive spatiotemporal receptive fields and a cross-modal learning scheme. The 3D deformable transformer consists of three attention modules: 3D deformability, local joint stride, and temporal stride attention. The two cross-modal tokens are input into the 3D deformable attention module to create a cross-attention token with a reflected spatiotemporal correlation. Local joint stride attention is applied to spatially combine attention and pose tokens. Temporal stride attention temporally reduces the number of input tokens in the attention module and supports temporal expression learning without the simultaneous use of all tokens. The deformable transformer iterates L-times and combines the last cross-modal token for classification. The proposed 3D deformable transformer was tested on the NTU60, NTU120, FineGYM, and PennAction datasets, and showed results better than or similar to pre-trained state-of-the-art methods even without a pre-training process. In addition, by visualizing important joints and correlations during action recognition through spatial joint and temporal stride attention, the possibility of achieving an explainable potential for action recognition is presented.


title: Harmonic maps on weighted Riemannian foliations

abstract: On foliations, there are two kinds of harmonic maps, that is, transversally harmonic map and $(F,F')$-harmonic map which are equivalent when the foliation is minimal. In this paper, we study transversally f-harmonic and $(F,F')_f$-harmonic maps on weighted foliations.


title: Nearby voids and their galaxies: recent progress and prospects

abstract: Voids occupy about 3/4 of the volume of the Universe and contain about 15% of its mass. Due to various observational selection effects, these structure elements and galaxies populating voids, are highly under-explored. This especially relates to the lowest mass galaxies which comprise the main void population. Studying the nearby voids allows us to improve our understanding of the most elusive void objects. We present the brief overview of the current status and the prospects of the study of the nearest voids and their galaxies. First, we summarize the pioneer study of a hundred galaxies residing in the nearby Lynx-Cancer void which clearly evidence for the slower evolution of void galaxies and finds also the unusual very metal-poor and gas-rich dwarfs. Then we describe the recently defined sample of the nearby voids within the sphere with R = 25 Mpc and a sample of 1350 galaxies residing in these voids (~20% of all galaxies within this volume). We discuss the current results obtained for several directions of the study of this sample. They include: the search for Very Young Galaxies, the study of HI properties, the clustering of void galaxies and its relation to the void substructures, and the unbiased study of 260 void galaxies within the Local Volume (R < 11 Mpc). Altogether, this opens a perspective way to address the suggested peculiarities of the void galaxy formation and evolution. Finally, we briefly overview the expected advancements in the void galaxy studies related to the upcoming new facilities.


title: Nearby SNR: a possible common origin to multi-messenger anomalies in spectra, ratios and anisotropy of cosmic rays

abstract: The multi-messenger anomalies, including spectral hardening or excess for nuclei, leptons, ratios of $\bar p/p$ and B/C, and anisotropic reversal, were observed in past years. AMS-02 experiment also revealed different spectral break for positron and electron at 284 GeV and beyond TeV respectively. It is natural to ask whether all those anomalies originate from one unified physical scenario. In this work, the spatially-dependent propagation (SDP) with a nearby SNR source is adopted to reproduce above mentioned anomalies. There possibly exists dense molecular cloud(DMC) around SNRs and the secondary particles can be produced by pp-collision or fragmentation between the accelerated primary cosmic rays and DMC. As a result, the spectral hardening for primary, secondary particles and ratios of $B/C$ and $\bar p/p$ can be well reproduced. Due to the energy loss at source age of 330 kyrs, the characteristic spectral break-off for primary electron is at about 1 TeV hinted from the measurements. The secondary positron and electron from charged pion take up $5\%$ energy from their mother particles, so the positron spectrum has a cut-off at $\sim$250 GeV. Therefore, the different spectral break for positron and electron together with other anomalies can be fulfilled in this unified physical scenario. More interesting is that we also obtain the featured structures as spectral break-off at 5 TV for secondary particles of Li, Be, B, which can be served to verify our model. We hope that those tagged structures can be observed by the new generation of space-borne experiment HERD in future.


title: A Measurement of the CMB Temperature Power Spectrum and Constraints on Cosmology from the SPT-3G 2018 TT/TE/EE Data Set

abstract: We present a sample-variance-limited measurement of the temperature power spectrum ($TT$) of the cosmic microwave background (CMB) using observations of a $\sim\! 1500 \,\mathrm{deg}^2$ field made by SPT-3G in 2018. We report multifrequency power spectrum measurements at 95, 150, and 220GHz covering the angular multipole range $750 \leq \ell < 3000$. We combine this $TT$ measurement with the published polarization power spectrum measurements from the 2018 observing season and update their associated covariance matrix to complete the SPT-3G 2018 $TT/TE/EE$ data set. This is the first analysis to present cosmological constraints from SPT $TT$, $TE$, and $EE$ power spectrum measurements jointly. We blind the cosmological results and subject the data set to a series of consistency tests at the power spectrum and parameter level. We find excellent agreement between frequencies and spectrum types and our results are robust to the modeling of astrophysical foregrounds. We report results for $\Lambda$CDM and a series of extensions, drawing on the following parameters: the amplitude of the gravitational lensing effect on primary power spectra $A_\mathrm{L}$, the effective number of neutrino species $N_{\mathrm{eff}}$, the primordial helium abundance $Y_{\mathrm{P}}$, and the baryon clumping factor due to primordial magnetic fields $b$. We find that the SPT-3G 2018 $T/TE/EE$ data are well fit by $\Lambda$CDM with a probability-to-exceed of $15\%$. For $\Lambda$CDM, we constrain the expansion rate today to $H_0 = 68.3 \pm 1.5\,\mathrm{km\,s^{-1}\,Mpc^{-1}}$ and the combined structure growth parameter to $S_8 = 0.797 \pm 0.042$. The SPT-based results are effectively independent of Planck, and the cosmological parameter constraints from either data set are within $<1\,\sigma$ of each other. (abridged)


title: Detecting Code Injections in Noisy Environments Through EM Signal Analysis and SVD Denoising

abstract: The penetration of embedded devices in networks that support critical applications has rendered them a lucrative target for attackers and evildoers. However, traditional protection mechanisms may not be supported due to the memory and computational limitations of these systems. Recently, the analysis of electromagnetic (EM) emanations has gathered the interest of the research community. Thus, analogous protection systems have emerged as a viable solution e.g., for providing external, non-intrusive control-flow attestation for resource-constrained devices. Unfortunately, the majority of current work fails to account for the implications of real-life factors, predominantly the impact of environmental noise. In this work, we introduce a framework that integrates singular value decomposition (SVD) along with outlier detection for discovering malicious modifications of embedded software even under variable conditions of noise. Our proposed framework achieves high detection accuracy i.e., above 93\% AUC score for unknown attacks, even for extreme noise conditions i.e., -10 SNR. To the best of our knowledge, this is the first time this realistic limiting factor, i.e., environmental noise, is successfully addressed in the context of EM-based anomaly detection for embedded devices.


title: Energy-recurrence Breakdown and Chaos in Disordered Fermi-Pasta-Ulam-Tsingou Lattices

abstract: In this paper, we consider the classic Fermi-Pasta-Ulam-Tsingou system as a model of interacting particles connected by harmonic springs with a quadratic nonlinear term (first system) and a set of second-order ordinary differential equations with variability (second system) that resembles Hamilton's equations of motion of the Fermi-Pasta-Ulam-Tsingou system. In the absence of variability, the second system becomes Hamilton's equations of motion of the Fermi-Pasta-Ulam-Tsingou system (first system). Variability is introduced to Hamilton's equations of motion of the Fermi-Pasta-Ulam-Tsingou system to take into account inherent variations (for example, due to manufacturing processes), giving rise to heterogeneity in its parameters. We demonstrate that a percentage of variability smaller than a threshold can break the well-known energy recurrence phenomenon and induce localization in the energy normal-mode space. However, percentage of variability larger than the threshold may make the trajectories of the second system blow up in finite time. Using a multiple-scale expansion, we derive analytically a two normal-mode approximation that explains the mechanism for energy localization and blow up in the second system. We also investigate the chaotic behavior of the two systems as the percentage of variability is increased, utilising the maximum Lyapunov exponent and Smaller Alignment Index. Our analysis shows that when there is almost energy localization in the second system, it is more probable to observe chaos, as the number of particles increases.


title: A global adaptive velocity space for general discrete velocity framework in predictions of rarefied and multi-scale flows

abstract: The rarefied flow and multi-scale flow are crucial for the aerodynamic design of spacecraft, ultra-low orbital vehicles and plumes. By introducing a discrete velocity space, the Boltzmann method, such as the discrete velocity method and unified methods, can capture complex and non-equilibrium velocity distribution functions (VDFs) and describe flow behaviors exactly. However, the extremely steep slope and high concentration of the gas VDFs in a local particle velocity space make it very difficult for the Boltzmann method with structured velocity space to describe high speed flow. Therefore, the adaptive velocity space (AVS) is required for the Boltzmann solvers to be practical in complex rarefied flow and multi-scale flow. This paper makes two improvements to the AVS approach, which is then incorporated into a general discrete velocity framework, such as the unified gas-kinetic scheme. Firstly, a global velocity mesh is used to prevent the interpolation of the VDFs at the physical interface during the calculation of the microscopic fluxes, maintaining the program's high level of parallelism. Secondly, rather than utilizing costly interpolation, the VDFs on a new velocity space were reconstruction using the ``consanguinity" relationship. In other words, a split child node's VDF is the same as its parent's VDF, and a merged parent's VDF is the average of its children's VDFs. Additionally, the discrete deviation of the equilibrium distribution functions is employed to maintain the proposed method's conservation. Moreover, an appropriate set of adaptive parameters is established to enhance the automation of the proposed method. Finally, a number of numerical tests are carried out to validate the proposed method.


title: The short memory limit for long time statistics in a stochastic Coleman-Gurtin model of heat conduction

abstract: We study a class of semi-linear differential Volterra equations with polynomial-type potentials that incorporates the effects of memory while being subjected to random perturbations via an additive Gaussian noise. We show that for a broad class of non-linear potentials and sufficiently regular noise the system always admits invariant probability measures, defined on the extended phase space, that possess higher regularity properties dictated by the structure of the nonlinearities in the equation. Furthermore, we investigate the singular limit as the memory kernel collapses to a Dirac function. Specifically, provided sufficiently many directions in the phase space are stochastically forced, we show that there is a unique stationary measure to which the system converges, in a suitable Wasserstein distance, at exponential rates independent of the decay of the memory kernel. We then prove the convergence of the statistically steady states to the unique invariant probability of the classical stochastic reaction-diffusion equation in the desired singular limit. As a consequence, we establish the validity of the small memory approximation for solutions on the infinite time horizon $[0,\infty)$.


title: High quality factor metasurfaces for two-dimensional wavefront manipulation

abstract: The strong interaction of light with micro- and nanostructures plays a critical role in optical sensing, nonlinear optics, active optical devices, and quantum optics. However, for wavefront shaping, the required local control over light at a subwavelength scale limits this interaction, typically leading to low-quality-factor optical devices. Here, we demonstrate an avenue towards high-quality-factor wavefront shaping in two spatial dimensions based on all-dielectric Huygens metasurfaces by leveraging higher-order Mie resonances. We design and experimentally realize transmissive band stop filters, beam deflectors and radial lenses with measured quality factors in the range of 202-1475 at near-infrared wavelengths. The excited optical mode and resulting wavefront control are both local, allowing versatile operation with finite apertures and oblique illumination. Our results represent an improvement in quality factor by nearly two orders of magnitude over previous localized mode designs, and provide a design approach for a new class of compact optical devices.


title: DRIVE: Dockerfile Rule Mining and Violation Detection

abstract: A Dockerfile defines a set of instructions to build Docker images, which can then be instantiated to support containerized applications. Recent studies have revealed a considerable amount of quality issues with Dockerfiles. In this paper, we propose a novel approach DRIVE (Dockerfiles Rule mIning and Violation dEtection) to mine implicit rules and detect potential violations of such rules in Dockerfiles. DRIVE firstly parses Dockerfiles and transforms them to an intermediate representation. It then leverages an efficient sequential pattern mining algorithm to extract potential patterns. With heuristic-based reduction and moderate human intervention, potential rules are identified, which can then be utilized to detect potential violations of Dockerfiles. DRIVE identifies 34 semantic rules and 19 syntactic rules including 9 new semantic rules which have not been reported elsewhere. Extensive experiments on real-world Dockerfiles demonstrate the efficacy of our approach.


title: Functional renormalization group for multilinear disordered Langevin dynamics II: Revisiting the $p=2\,$ spin dynamics for Wigner and Wishart ensembles

abstract: In this paper, we investigate the large-time behavior for a slightly modified version of the standard p=2 soft spins dynamics model, including a quartic or higher potential. The equilibrium states of such a model correspond to an effective field theory, which has been recently considered as a novel paradigm for signal detection in data science based on the renormalization group argument. We consider a Langevin-like equation, including a disorder term that leaves in the Wigner or Wishart ensemble. Then we construct a nonperturbative renormalization group formalism valid in the large N limit, where eigenvalues distributions for the disorder can be replaced by their analytic limits, namely the Wigner and Marchenko-Pastur laws. One of the main advantages of this approach is that the interactions remain local in time, avoiding the non-locality arising from the approaches that integrate out the disorder at the partition function level.


title: Price & Choose

abstract: We describe a two-stage mechanism that fully implements the set of efficient outcomes in two-agent environments with quasi-linear utilities. The mechanism asks one agent to set prices for each outcome, and the other agent to make a choice, paying the corresponding price: Price \& Choose. We extend our implementation result in three main directions: an arbitrary number of players, non-quasi linear utilities, and robustness to max-min behavior. Finally, we discuss how to reduce the payoff inequality between players while still achieving efficiency.


title: Formal Theory: Status and Outlook

abstract: A very brief overview is presented on some of the current most active areas of research in formal aspects of High Energy Physics and Cosmology. Including the recent breakthrough on the black hole information paradox, developments on amplitudes, the bootstrap and swampland programmes as well as progress towards realistic UV complete models of particle physics and cosmology. Perspectives on future contact with observations are discussed, emphasising the long term prospect for ultra high frequency gravitational waves to test early universe physics beyond the Standard Model.


title: PyPop7: A Pure-Python Library for Population-Based Black-Box Optimization

abstract: In this paper, we present a pure-Python library called PyPop7 for black-box optimization (BBO). As population-based methods are becoming increasingly popular for BBO, our design goal is to provide a unified API and elegant implementations for them, particularly in high-dimensional cases. Since population-based methods suffer easily from the curse of dimensionality owing to their random sampling nature, various improvements have been proposed to alleviate this issue via exploiting possible problem structures: such as space decomposition, low-memory approximation, low-rank metric learning, variance reduction, ensemble of random subspaces, model self-adaptation, and smoothing. Now PyPop7 has covered these advances with $>72$ versions and variants of 13 BBO algorithm families from different research communities. Its open-source code and full-fledged documents are available at https://github.com/Evolutionary-Intelligence/pypop and https://pypop.readthedocs.io, respectively.


title: Spatial-temporal traffic modeling with a fusion graph reconstructed by tensor decomposition

abstract: Accurate spatial-temporal traffic flow forecasting is essential for helping traffic managers to take control measures and drivers to choose the optimal travel routes. Recently, graph convolutional networks (GCNs) have been widely used in traffic flow prediction owing to their powerful ability to capture spatial-temporal dependencies. The design of the spatial-temporal graph adjacency matrix is a key to the success of GCNs, and it is still an open question. This paper proposes reconstructing the binary adjacency matrix via tensor decomposition, and a traffic flow forecasting method is proposed. First, we reformulate the spatial-temporal fusion graph adjacency matrix into a three-way adjacency tensor. Then, we reconstructed the adjacency tensor via Tucker decomposition, wherein more informative and global spatial-temporal dependencies are encoded. Finally, a Spatial-temporal Synchronous Graph Convolutional module for localized spatial-temporal correlations learning and a Dilated Convolution module for global correlations learning are assembled to aggregate and learn the comprehensive spatial-temporal dependencies of the road network. Experimental results on four open-access datasets demonstrate that the proposed model outperforms state-of-the-art approaches in terms of the prediction performance and computational cost.


title: Changes in Power and Information Flow in Resting-state EEG by Working Memory Process

abstract: Many studies have analyzed working memory (WM) from electroencephalogram (EEG). However, little is known about changes in the brain neurodynamics among resting-state (RS) according to the WM process. Here, we identified frequency-specific power and information flow patterns among three RS EEG before and after WM encoding and WM retrieval. Our results demonstrated the difference in power and information flow among RS EEG in delta (1-3.5 Hz), alpha (8-13.5 Hz), and beta (14-29.5 Hz) bands. In particular, there was a marked increase in the alpha band after WM retrieval. In addition, we calculated the association between significant characteristics of RS EEG and WM performance, and interestingly, correlations were found only in the alpha band. These results suggest that RS EEG according to the WM process has a significant impact on the variability and WM performance of brain mechanisms in relation to cognitive function.


title: Spectral function of the $\eta'$ meson in nuclear medium based on phenomenological models

abstract: The in-medium modification of the spectral function of the $\eta'$ meson with and without the spatial momentum is studied with the $T\rho$ approximation by employing two phenomenological models for the $\eta'N$ scattering; one is called coupled channels model and the other the $N(1895)$-dominance model. In the former model, the $\eta'N$ scattering amplitude is calculated in the unitarized coupled-channel approach involving the $\eta'N$ channel, while in the latter model the $\eta'N$ scattering process is dominated by the $N(1895)$ resonance with the spin and parity $J^P=1/2^-$. In the \com{coupled channels model}, one single peak of the in-medium $\eta'$ mode appears in the spectral function and the peak position shifts to higher energies along with the increase of the nuclear density reflecting the repulsive $\eta'N$ scattering length of the unitarized coupled-channel amplitude. On the other hand, two branches related to the $\eta'$ and $N(1895)$-hole modes appear in the $N(1895)$-dominance model. In both models, the shift of the peak position and the width in the spectral function are a few tens of MeV at the normal nuclear density for the $\eta'$ meson at rest in the nuclear medium. Once the spatial momentum is turned on, the peak positions in the spectral function approach the energies without the nuclear medium effect. Particularly, in the $N(1895)$-dominance model, the peak strength of the $N(1895)$-hole mode gets smaller with the finite momentum and the spectral function comes to have one single peak.


title: Wireless Channel Delay Spread Performance Evaluation of a Building Layout

abstract: Evaluating a building's wireless performance during the building design process is a new paradigm for wireless communications and building design. This paper proposes the earliest building wireless performance (BWP) evaluation theory focusing on the channel delay spread (DS). The novel contributions of this paper lie in the following aspects. 1) We define a new metric called DS gain, which is the first metric for evaluating the channel DS performance of a building under design. 2) We propose an analytical model to compute the metric quickly and accurately. 3) The proposed scheme is validated via Monte-Carlo simulations under typical indoor scenarios. Numerical results reveal that building design has a clear impact on the root mean square (RMS) DS. In the future, architects need to design a building taking its DS gain into account carefully. Otherwise, indoor networks in it will suffer from severe signal inter-symbol interference (ISI) due to an over large DS gain.


title: Extension of Realisations for Low-Dimensional Lie Algebras and Relative Differential Invariants

abstract: We start with a realisation of a Lie algebra with the basis operators $L=\langle Q_m\rangle$, $Q_m=\zeta_{mj}(x_i)\partial_{x_j}$, where $x_i$ are some variables that may be regarded as dependent or independent in construction of some equations or differential invariants. We take additional variables $R_k$, and study the linearly extended action operators $ {\hat Q_m}={Q_m}+\lambda_{mjk}R_j\partial_{R_k}$ that form the same Lie algebra with the same structural constants. For a fixed realisation of any Lie algebra $L$ we can classify all inequivalent extended action realisations for a finite number of additional variables. Such realisations allow to construct new invariant equations for the same realisation of the algebra, but involving additional variables, and to classify exhaustively relative differential invariants and invariant equations for the respective realisations of Lie algebras. They can be also applied to other problems in the symmetry analysis of differential equations. Here we classify extensions of realisations for inequivalent low-dimensional Lie algebras. The problem of classification of the relative differential invariants has an interesting story attached to it, and the background section may be worth reading not only for people in the field.


title: A family of Barzilai-Borwein steplengths from the viewpoint of scaled total least squares

abstract: The Barzilai-Borwein (BB) steplengths play great roles in practical gradient methods for solving unconstrained optimization problems. Motivated by the observation that the two well-known BB steplengths correspond to the ordinary and the data least squares, respectively, we present a family of BB steplengths from the viewpoint of scaled total least squares. Numerical experiments demonstrate that a high performance can be received by a carefully-selected BB steplength in the new family.


title: Accurate and fast deep learning dose prediction for a preclinical microbeam radiation therapy study using low-statistics Monte Carlo simulations

abstract: Microbeam radiation therapy (MRT) utilizes coplanar synchrotron radiation beamlets and is a proposed treatment approach for several tumour diagnoses that currently have poor clinical treatment outcomes, such as gliosarcomas. Prescription dose estimations for treating preclinical gliosarcoma models in MRT studies at the Imaging and Medical Beamline at the Australian Synchrotron currently rely on Monte Carlo (MC) simulations. The steep dose gradients associated with the 50$\,\mu$m wide coplanar beamlets present a significant challenge for precise MC simulation of the MRT irradiation treatment field in a short time frame. Much research has been conducted on fast dose estimation methods for clinically available treatments. However, such methods, including GPU Monte Carlo implementations and machine learning (ML) models, are unavailable for novel and emerging cancer radiation treatment options like MRT. In this work, the successful application of a fast and accurate machine learning dose prediction model in a retrospective preclinical MRT rodent study is presented for the first time. The ML model predicts the peak doses in the path of the microbeams and the valley doses between them, delivered to the gliosarcoma in rodent patients. The predictions of the ML model show excellent agreement with low-noise MC simulations, especially within the investigated tumour volume. This agreement is despite the ML model being deliberately trained with MC-calculated samples exhibiting significantly higher statistical uncertainties. The successful use of high-noise training set data samples, which are much faster to generate, encourages and accelerates the transfer of the ML model to different treatment modalities for other future applications in novel radiation cancer therapies.


title: Can we constrain galaxy geometry parameters using spatially integrated SED fitting?

abstract: Sophisticated spectral energy distribution (SED) models describe dust attenuation and emission using geometry parameters. This treatment is natural since dust effects are driven by the underlying star-dust geometry in galaxies. An example is the Starduster SED model, which divides a galaxy into a stellar disk, a stellar bulge, and a dust disk. This work utilises the Starduster SED model to study the efficacy of inferring geometry parameters using spatially integrated SED fitting. Our method fits the SED model to mock photometry produced by combining a semi-analytic model with the same SED model. Our fitting results imply that the disk radius can be constrained, while the inclination angle, dust disk to stellar disk radius ratio, bulge radius and intrinsic bulge to total luminosity ratio are unconstrained, even though 21 filters from UV to FIR are used. We also study the impact of S/N, finding that the increase of S/N (up to 80) brings limited improvements to the results. We provide a detailed discussion to explain these findings, and point out the implications for models with more general geometry.


title: Single-photon-memory measurement-device-independent quantum secure direct communication

abstract: Quantum secure direct communication (QSDC) uses the quantum channel to transmit information reliably and securely. In order to eliminate the security loopholes resulting from practical detectors, the measurement-device-independent (MDI) QSDC protocol has been proposed. However, block-based transmission of quantum states is utilized in MDI-QSDC, which requires practical quantum memory that is still unavailable at the time of writing. For circumventing this impediment, we propose a single-photon-memory MDI QSDC protocol (SPMQC) for dispensing with high-performance quantum memory. The performance of the proposed protocol is characterized by simulations considering realistic experimental parameters, and the results show that it is feasible to implement SPMQC by relying on present-day technology.


title: Optimal Planning of Hybrid Energy Storage Systems using Curtailed Renewable Energy through Deep Reinforcement Learning

abstract: Energy management systems (EMS) are becoming increasingly important in order to utilize the continuously growing curtailed renewable energy. Promising energy storage systems (ESS), such as batteries and green hydrogen should be employed to maximize the efficiency of energy stakeholders. However, optimal decision-making, i.e., planning the leveraging between different strategies, is confronted with the complexity and uncertainties of large-scale problems. Here, we propose a sophisticated deep reinforcement learning (DRL) methodology with a policy-based algorithm to realize the real-time optimal ESS planning under the curtailed renewable energy uncertainty. A quantitative performance comparison proved that the DRL agent outperforms the scenario-based stochastic optimization (SO) algorithm, even with a wide action and observation space. Owing to the uncertainty rejection capability of the DRL, we could confirm a robust performance, under a large uncertainty of the curtailed renewable energy, with a maximizing net profit and stable system. Action-mapping was performed for visually assessing the action taken by the DRL agent according to the state. The corresponding results confirmed that the DRL agent learns the way like what a human expert would do, suggesting reliable application of the proposed methodology.


title: On an Interpretation of ResNets via Solution Constructions

abstract: This paper first constructs a typical solution of ResNets for multi-category classifications by the principle of gate-network controls and deep-layer classifications, from which a general interpretation of the ResNet architecture is given and the performance mechanism is explained. We then use more solutions to further demonstrate the generality of that interpretation. The universal-approximation capability of ResNets is proved.


title: Indirect Evidence for Dark Matter Density Spikes around Stellar-Mass Black Holes

abstract: It has been suggested for a long time that dark matter would form a density spike around a black hole. However, no promising evidence has been observed so far to verify this theoretical suggestion. Here, we report the existence of a dark matter density spike around each of the two nearby stellar-mass black holes (A0620-00 and XTE J1118+480). The dynamical friction between dark matter and the companion stars can satisfactorily explain the abnormally fast orbital decays in the two binaries. The calculated spike index for A0620-00 and XTE J1118+480 are $\gamma=1.71^{+0.01}_{-0.02}$ and $\gamma=1.85^{+0.04}_{-0.04}$ respectively, which are close to the lower regime predicted by the stellar heating model. It may provide a possible indirect evidence for the existence of dark matter density spikes around stellar-mass black holes. We anticipate that analyzing observational data of nearby black hole X-ray binaries would be a new way to reveal the nature of dark matter.


title: 3D Bosons, 3-Jack polynomials and affine Yangian of ${\mathfrak{gl}}(1)$

abstract: 3D (3 dimensional) Young diagrams are a generalization of 2D Young diagrams. In this paper, We consider 3D Bosons and 3-Jack polynomials. We associate three parameters $h_1,h_2,h_3$ to $y,x,z$-axis respectively. 3-Jack polynomials are polynomials of $P_{n,j}, n\geq j$ with coefficients in $\mathbb C(h_1,h_2,h_3)$, which are the generalization of Schur functions and Jack polynomials to 3D case. Similar to Schur functions, 3-Jack polynomials can also be determined by the vertex operators and the Pieri formulas.


title: A SAT approach to the initial mapping problem in SWAP gate insertion for commuting gates

abstract: Most quantum circuits require SWAP gate insertion to run on quantum hardware with limited qubit connectivity. A promising SWAP gate insertion method for blocks of commuting two-qubit gates is a predetermined swap strategy which applies layers of SWAP gates simultaneously executable on the coupling map. A good initial mapping for the swap strategy reduces the number of required swap gates. However, even when a circuit consists of commuting gates, e.g., as in the Quantum Approximate Optimization Algorithm (QAOA) or trotterized simulations of Ising Hamiltonians, finding a good initial mapping is a hard problem. We present a SAT-based approach to find good initial mappings for circuits with commuting gates transpiled to the hardware with swap strategies. Our method achieves a 65% reduction in gate count for random three-regular graphs with 500 nodes. In addition, we present a heuristic approach that combines the SAT formulation with a clustering algorithm to reduce large problems to a manageable size. This approach reduces the number of swap layers by 25% compared to both a trivial and random initial mapping for a random three-regular graph with 1000 nodes. Good initial mappings will therefore enable the study of quantum algorithms, such as QAOA and Ising Hamiltonian simulation applied to sparse problems, on noisy quantum hardware with several hundreds of qubits.


title: Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection

abstract: Online media data, in the forms of images and videos, are becoming mainstream communication channels. However, recent advances in deep learning, particularly deep generative models, open the doors for producing perceptually convincing images and videos at a low cost, which not only poses a serious threat to the trustworthiness of digital information but also has severe societal implications. This motivates a growing interest of research in media tampering detection, i.e., using deep learning techniques to examine whether media data have been maliciously manipulated. Depending on the content of the targeted images, media forgery could be divided into image tampering and Deepfake techniques. The former typically moves or erases the visual elements in ordinary images, while the latter manipulates the expressions and even the identity of human faces. Accordingly, the means of defense include image tampering detection and Deepfake detection, which share a wide variety of properties. In this paper, we provide a comprehensive review of the current media tampering detection approaches, and discuss the challenges and trends in this field for future research.


title: Future Space Networks: Toward the Next Giant Leap for Humankind

abstract: Due to the unprecedented advances in satellite fabrication and deployment, innovative communications and networking technologies, ambitious space projects and programs, and the resurgence of interest in satellite networks, there is a need to redefine space networks (SpaceNets) to incorporate all of these evolutions. This paper introduces a vision for future SpaceNets that considers advances in several related domains. First, we present a reference architecture that captures the various network entities and terminals in a holistic manner. Based on this, space, air, and ground use cases are studied. Then, the architectures and technologies that enable the envisaged SpaceNets are investigated. In so doing, we highlight the activities and projects of different standardization bodies, satellite operators, and national organizations towards the envisioned SpaceNets. Finally, the challenges, potential solutions, and open issues from communications and networking perspectives are discussed.


title: Development of Personalized Sleep Induction System based on Mental States

abstract: Sleep is an essential behavior to prevent the decrement of cognitive, motor, and emotional performance and various diseases. However, it is not easy to fall asleep when people want to sleep. There are various sleep-disturbing factors such as the COVID-19 situation, noise from outside, and light during the night. We aim to develop a personalized sleep induction system based on mental states using electroencephalogram and auditory stimulation. Our system analyzes users' mental states using an electroencephalogram and results of the Pittsburgh sleep quality index and Brunel mood scale. According to mental states, the system plays sleep induction sound among five auditory stimulation: white noise, repetitive beep sounds, rainy sound, binaural beat, and sham sound. Finally, the sleep-inducing system classified the sleep stage of participants with 94.7 percent and stopped auditory stimulation if participants showed non-rapid eye movement sleep. Our system makes 18 participants fall asleep among 20 participants.


title: Unitarity and unstable-particle scattering amplitudes

abstract: Unitarity is the fundamental property of the S-matrix while its usage for a scattering of unstable particles has been subtle as unstable particles do not appear in the asymptotic states. Defining unstable-particle amplitudes as residues of a higher-point amplitude at an appropriate complex pole, we find unitarity equations for the 2-to-2 unstable-particle amplitudes from unitarity and analyticity of stable-particle scattering amplitudes. The unstable-particle unitarity equations take a form analogous to those of the stable-particle amplitudes when the in and out states are chosen to be complex-conjugate positions. In particular, as in the optical theorem, we find a positivity constraint on a discontinuity of the amplitudes in a positive region of the momentum transfer variable.


title: Saddle-Point Approach to Large-Time Volatility Smile

abstract: We extend upon the saddle-point equation presented in [1] to derive large-time model-implied volatility smiles, providing its theoretical foundation and studying its applications in classical models. As long as characteristic function fulfills a L\'evy-type scaling behavior in large time, the approach allows us to study analytically the large-time smile behaviors under specific models, and moreover, to reach a very wide class of arbitrage-free model-inspired parametrizations, in the same manner as stochastic-volatility-inspired (SVI).


title: Hybrid Censored Quantile Regression Forest to Assess the Heterogeneous Effects

abstract: In many applications, heterogeneous treatment effects on a censored response variable are of primary interest, and it is natural to evaluate the effects at different quantiles (e.g., median). The large number of potential effect modifiers, the unknown structure of the treatment effects, and the presence of right censoring pose significant challenges. In this paper, we develop a hybrid forest approach called Hybrid Censored Quantile Regression Forest (HCQRF) to assess the heterogeneous effects varying with high-dimensional variables. The hybrid estimation approach takes advantage of the random forests and the censored quantile regression. We propose a doubly-weighted estimation procedure that consists of a redistribution-of-mass weight to handle censoring and an adaptive nearest neighbor weight derived from the forest to handle high-dimensional effect functions. We propose a variable importance decomposition to measure the impact of a variable on the treatment effect function. Extensive simulation studies demonstrate the efficacy and stability of HCQRF. The result of the simulation study also convinces us of the effectiveness of the variable importance decomposition. We apply HCQRF to a clinical trial of colorectal cancer. We achieve insightful estimations of the treatment effect and meaningful variable importance results. The result of the variable importance also confirms the necessity of the decomposition.


title: Binary Error-Correcting Codes with Minimal Noiseless Feedback

abstract: In the setting of error-correcting codes with feedback, Alice wishes to communicate a $k$-bit message $x$ to Bob by sending a sequence of bits over a channel while noiselessly receiving feedback from Bob. It has been long known (Berlekamp, 1964) that in this model, Bob can still correctly determine $x$ even if $\approx \frac13$ of Alice's bits are flipped adversarially. This improves upon the classical setting without feedback, where recovery is not possible for error fractions exceeding $\frac14$. The original feedback setting assumes that after transmitting each bit, Alice knows (via feedback) what bit Bob received. In this work, our focus in on the limited feedback model, where Bob is only allowed to send a few bits at a small number of pre-designated points in the protocol. For any desired $\epsilon > 0$, we construct a coding scheme that tolerates a fraction $ 1/3-\epsilon$ of bit flips relying only on $O_\epsilon(\log k)$ bits of feedback from Bob sent in a fixed $O_\epsilon(1)$ number of rounds. We complement this with a matching lower bound showing that $\Omega(\log k)$ bits of feedback are necessary to recover from an error fraction exceeding $1/4$ (the threshold without any feedback), and for schemes resilient to a fraction $1/3-\epsilon$ of bit flips, the number of rounds must grow as $\epsilon \to 0$. We also study (and resolve) the question for the simpler model of erasures. We show that $O_\epsilon(\log k)$ bits of feedback spread over $O_\epsilon(1)$ rounds suffice to tolerate a fraction $(1-\epsilon)$ of erasures. Likewise, our $\Omega(\log k)$ lower bound applies for erasure fractions exceeding $1/2$, and an increasing number of rounds are required as the erasure fraction approaches $1$.


title: A Single Server Queue Control Problem in Heavy Traffic

abstract: We address a single server queue control problem (QCP) in heavy traffic, originating from Lee and Weerasinghe (2011) (see \cite{lee2011convergence}). We employ their single server queueing model, where the state process is the offered waiting time process, the customer arrival process has a state-dependent intensity, and service times and customer's patience times are i.i.d with general distributions. We introduce an infinite-horizon discounted cost functional generated by two types of costs associated with the queueing model: a control cost related to the use of control and a penalty for idleness cost. Our major contribution lies in solving the QCP with a non-trivial cost function for the control cost. Under mild assumptions, the heavy traffic limit of the QCP yields a stochastic control problem described by a stochastic differential equation, which we call a diffusion control problem (DCP). We solve the corresponding DCP with the help of the Legendre-Fenchel transformation and a formal Hamilton-Jacobi-Bellman (HJB) equation to find an optimal control. We provide the existence and uniqueness of the corresponding admissible control system by a comparison result. Then we ``convert" the optimal strategy of the DCP to the QCP of which we obtain a nearly optimal solution. As a consequence, we deduce an asymptotically optimal solution to the unsolved QCP in \cite{lee2011convergence}.


title: Master equations for finite state mean field games with nonlinear activations

abstract: We formulate a class of mean field games on a finite state space with variational principles resembling those in continuous-state mean field games. We construct a controlled continuity equation featuring a nonlinear activation function on graphs induced by finite-state reversible continuous time Markov chains. In these graphs, each edge is weighted by the transition probability and invariant measure of the original process. Using these controlled dynamics on the graph and the dynamic programming principle for the value function, we derive several key components: the mean field game systems, the functional Hamilton-Jacobi equations, and the master equations on a finite probability space for potential mean field games. The existence and uniqueness of solutions to the potential mean field game system are ensured through a convex optimization reformulation in terms of the density-flux pair. We also derive variational principles for the master equations of both non-potential games and mixed games on a continuous state space. Finally, we offer several concrete examples of discrete mean field game dynamics on a two-point space, complete with closed-formula solutions. These examples include discrete Wasserstein distances, mean field planning, and potential mean field games.


title: On the Feasibility of Self-Powered Linear Feedback Control

abstract: A control system is called self-powered if the only energy it requires for operation is that which it absorbs from the plant. For a linear feedback law to be feasible for a self-powered control system, its feedback signal must be colocated with the control inputs, and its input-output mapping must satisfy an associated passivity constraint. The imposition of such a feedback law can be viewed equivalently as the imposition of a linear passive shunt admittance at the actuation ports of the plant. In this paper we consider the use of actively-controlled electronics to impose a self-powered linear feedback law. To be feasible, it is insufficient that the imposed admittance be passive, because parasitic losses must additionally be overcome. We derive sufficient feasibility conditions which explicitly account for these losses. In the finite-dimensional, time-invariant case, the feasibility condition distills to a more conservative version of the Positive Real Lemma, which is parametrized by various loss parameters. Three examples are given, in which this condition is used to determine the least-efficient loss parameters necessary to realize a desired feedback law.


title: Masked autoencoders are effective solution to transformer data-hungry

abstract: Vision Transformers (ViTs) outperforms convolutional neural networks (CNNs) in several vision tasks with its global modeling capabilities. However, ViT lacks the inductive bias inherent to convolution making it require a large amount of data for training. This results in ViT not performing as well as CNNs on small datasets like medicine and science. We experimentally found that masked autoencoders (MAE) can make the transformer focus more on the image itself, thus alleviating the data-hungry issue of ViT to some extent. Yet the current MAE model is too complex resulting in over-fitting problems on small datasets. This leads to a gap between MAEs trained on small datasets and advanced CNNs models still. Therefore, we investigated how to reduce the decoder complexity in MAE and found a more suitable architectural configuration for it with small datasets. Besides, we additionally designed a location prediction task and a contrastive learning task to introduce localization and invariance characteristics for MAE. Our contrastive learning task not only enables the model to learn high-level visual information but also allows the training of MAE's class token. This is something that most MAE improvement efforts do not consider. Extensive experiments have shown that our method shows state-of-the-art performance on standard small datasets as well as medical datasets with few samples compared to the current popular masked image modeling (MIM) and vision transformers for small datasets.The code and models are available at https://github.com/Talented-Q/SDMAE.


title: New translations associated with the special affine Fourier transform and shift invariant spaces

abstract: The translation operator $T^A$ associated with the special affine Fourier transform (SAFT) $\mathscr{F}_A$ is introduced from harmonic analysis point of view. The shift invariant space $V_A$ associated with the special affine Fourier transform is introduced and studied along with sampling problems.


title: Evolutionary Multitasking with Solution Space Cutting for Point Cloud Registration

abstract: Point cloud registration (PCR) is a popular research topic in computer vision. Recently, the registration method in an evolutionary way has received continuous attention because of its robustness to the initial pose and flexibility in objective function design. However, most evolving registration methods cannot tackle the local optimum well and they have rarely investigated the success ratio, which implies the probability of not falling into local optima and is closely related to the practicality of the algorithm. Evolutionary multi-task optimization (EMTO) is a widely used paradigm, which can boost exploration capability through knowledge transfer among related tasks. Inspired by this concept, this study proposes a novel evolving registration algorithm via EMTO, where the multi-task configuration is based on the idea of solution space cutting. Concretely, one task searching in cut space assists another task with complex function landscape in escaping from local optima and enhancing successful registration ratio. To reduce unnecessary computational cost, a sparse-to-dense strategy is proposed. In addition, a novel fitness function robust to various overlap rates as well as a problem-specific metric of computational cost is introduced. Compared with 8 evolving approaches, 4 traditional approaches and 3 deep learning approaches on the object-scale and scene-scale registration datasets, experimental results demonstrate that the proposed method has superior performances in terms of precision and tackling local optima.