title: Familiarity Facilitates Adoption: Evidence from Electric Vehicles

abstract: This paper shows that a non-price intervention which increased the prevalence of a new technology facilitated its further adoption. The BlueLA program put Electric Vehicles (EVs) for public use in many heavily trafficked areas, primarily (but not exclusively) aimed at low-to-middle income households. We show, using data on subsidies for these households and a difference-in differences strategy, that BlueLA is associated with a 33\% increase of new EV adoptions, justifying a substantial portion of public investment. While the program provides a substitute to car ownership, our findings are consistent with the hypothesis that increasing familiarity with EVs could facilitate adoption.


title: Ruling out light axions: the writing is on the wall

abstract: We revisit the domain wall problem for QCD axion models with more than one quark charged under the Peccei-Quinn symmetry. Symmetry breaking during or after inflation results in the formation of a domain wall network which would cause cosmic catastrophe if it comes to dominate the Universe. The network may be made unstable by invoking a `tilt' in the axion potential due to Planck scale suppressed non-renormalisable operators. Alternatively the random walk of the axion field during inflation can generate a `bias' favouring one of the degenerate vacua, but we find that this mechanism is in practice irrelevant. Consideration of the axion abundance generated by the decay of the wall network then requires the Peccei-Quinn scale to be rather low -- thus ruling out e.g. the DFSZ axion with mass below 11 meV, where most experimental searches are in fact focussed.


title: Quantum field theory and the structure of the Standard Model

abstract: The Standard Model of the electroweak and strong interactions of particle physics is a quantum field theory. Elementary particles are not indivisible `pieces' of matter but energy bundles of fields, whose properties and interactions are a consequence of the principles of symmetry. These lecture notes provide a brief introduction to the construction of the Standard Model from its basic ingredients: Poincar\'e symmetry, gauge invariance and spontaneous symmetry breaking. The full Lagrangian is derived in detail and the most relevant aspects of the electroweak phenomenology are discussed with special emphasis on the determination of the input parameters and the consistency checks of the model. Some exercises are proposed to fix the main ideas.


title: Disk dissipation, giant planet formation and star-formation-rate fluctuations in the past three-million-year history of Gould's Belt

abstract: Although episodic star formation (SF) had been suggested for nearby SF regions, a panoramic view to the latest episodic SF history in the solar neighborhood is still missing. By uniformly constraining the slope $\alpha$ of infrared spectral energy distributions (SEDs) of young stellar objects (YSOs) in the 13 largest Gould's Belt (GB) protoclusters surveyed by Spitzer Space Telescope, we have constructed a cluster-averaged histogram of $\alpha$ representing YSO evolution lifetime as a function of the $\alpha$ value. Complementary to the traditional SED classification scheme (0, I, F, II, III) that is based on different $\alpha$ values, a staging scheme (A,B,C,D,E) of SED evolution is advised on the basis of the $\alpha$ statistical features that can be better matched to the physical stages of disk dissipation and giant planet formation. This has also allowed us to unravel the fluctuations of star formation rate (SFR) in the past three-million-year (3 Myr) history of these GB protoclusters. Diverse evolutionary patterns such as single peak, double peaks and on-going acceleration of SFR are revealed. The SFR fluctuations are between $20\%\sim60\%$ ($\sim40\%$ on average) and no dependence on the average SFR or the number of SFR episodes is found. However, spatially close protoclusters tend to share similar SFR fluctuation trends, indicating that the driving force of the fluctuations should be at size scales beyond the typical cluster sizes of several parsec.


title: Cross-domain Microscopy Cell Counting by Disentangled Transfer Learning

abstract: Microscopy images from different imaging conditions, organs, and tissues often have numerous cells with various shapes on a range of backgrounds. As a result, designing a deep learning model to count cells in a source domain becomes precarious when transferring them to a new target domain. To address this issue, manual annotation costs are typically the norm when training deep learning-based cell counting models across different domains. In this paper, we propose a cross-domain cell counting approach that requires only weak human annotation efforts. Initially, we implement a cell counting network that disentangles domain-specific knowledge from domain-agnostic knowledge in cell images, where they pertain to the creation of domain style images and cell density maps, respectively. We then devise an image synthesis technique capable of generating massive synthetic images founded on a few target-domain images that have been labeled. Finally, we use a public dataset consisting of synthetic cells as the source domain, where no manual annotation cost is present, to train our cell counting network; subsequently, we transfer only the domain-agnostic knowledge to a new target domain of real cell images. By progressively refining the trained model using synthesized target-domain images and several real annotated ones, our proposed cross-domain cell counting method achieves good performance compared to state-of-the-art techniques that rely on fully annotated training images in the target domain. We evaluated the efficacy of our cross-domain approach on two target domain datasets of actual microscopy cells, demonstrating the feasibility of requiring annotations on only a few images in a new domain.


title: Gender Biases Unexpectedly Fluctuate in the Pre-training Stage of Masked Language Models

abstract: Masked language models pick up gender biases during pre-training. Such biases are usually attributed to a certain model architecture and its pre-training corpora, with the implicit assumption that other variations in the pre-training process, such as the choices of the random seed or the stopping point, have no effect on the biases measured. However, we show that severe fluctuations exist at the fundamental level of individual templates, invalidating the assumption. Further against the intuition of how humans acquire biases, these fluctuations are not correlated with the certainty of the predicted pronouns or the profession frequencies in pre-training corpora. We release our code and data to benefit future research.


title: Derandomization under Different Resource Constraints

abstract: We provide another proof to the EL Theorem. We show the tradeoff between compressibility of codebooks and their communication capacity. A resource bounded version of the EL Theorem is proven. This is used to prove three instances of resource bounded derandomization. This paper is in support of the general claim that if the existence of an object can be proven with the probabilistic method, then bounds on its Kolmogorov complexity can be proven as well.


title: Elastic scattering of 3He+4He with SONIK

abstract: Measurements of the elastic scattering cross section of 3He and 4He are important in order to improve constraints on theoretical models of 4He(3He,g)7Be, a key reaction in Big Bang nucleosynthesis and solar neutrino production. The astrophysical S-factor for this reaction is a significant source of uncertainty in the standard solar-model prediction of the 7Be and 8B solar neutrino fluxes. The elastic scattering measurements reported in the literature do not extend to low energies and lack proper uncertainty quantification. A new measurement of the 4He(3He,3He)4He reaction has been made at center-of-mass energies Ec.m. = 0.38-3.13 MeV using the Scattering of Nuclei in Inverse Kinematics (SONIK) scattering chamber: a windowless, extended gas target surrounded by an array of 30 collimated silicon charged particle detectors situated at TRIUMF. This is the first elastic scattering measurement of 3He+4He made below 500 keV and it has greater angular range and better precision than previous measurements. The elastic scattering data were analyzed using both R-matrix and Halo Effective Field Theory (Halo EFT) frameworks, and values of the s-wave scattering length and effective range were extracted. The resulting improvement in knowledge of the s-wave effective-range function at low energies will reduce the overall uncertainty in S34 at solar energies.


title: SCAPHY: Detecting Modern ICS Attacks by Correlating Behaviors in SCADA and PHYsical

abstract: Modern Industrial Control Systems (ICS) attacks evade existing tools by using knowledge of ICS processes to blend their activities with benign Supervisory Control and Data Acquisition (SCADA) operation, causing physical world damages. We present SCAPHY to detect ICS attacks in SCADA by leveraging the unique execution phases of SCADA to identify the limited set of legitimate behaviors to control the physical world in different phases, which differentiates from attackers activities. For example, it is typical for SCADA to setup ICS device objects during initialization, but anomalous during processcontrol. To extract unique behaviors of SCADA execution phases, SCAPHY first leverages open ICS conventions to generate a novel physical process dependency and impact graph (PDIG) to identify disruptive physical states. SCAPHY then uses PDIG to inform a physical process-aware dynamic analysis, whereby code paths of SCADA process-control execution is induced to reveal API call behaviors unique to legitimate process-control phases. Using this established behavior, SCAPHY selectively monitors attackers physical world-targeted activities that violates legitimate processcontrol behaviors. We evaluated SCAPHY at a U.S. national lab ICS testbed environment. Using diverse ICS deployment scenarios and attacks across 4 ICS industries, SCAPHY achieved 95% accuracy & 3.5% false positives (FP), compared to 47.5% accuracy and 25% FP of existing work. We analyze SCAPHYs resilience to futuristic attacks where attacker knows our approach.


title: Dynamic Soaring as a Means to Exceed the Solar Wind Speed

abstract: A technique by which a spacecraft can interact with flows of ionized gas in space (the solar wind or interstellar medium) to be accelerated to velocities greater than the wind velocity is explored. Inspired by the dynamic soaring maneuvers performed by sea birds and gliders in which differences in wind speed are exploited to gain velocity, in the proposed technique a lift-generating spacecraft circles between regions of the heliosphere that have different wind speeds, gaining energy without the use of propellant and only modest onboard power requirements. The spacecraft motion can be modeled as a series of elastic collisions between regions of the medium moving at different speeds. Models of the trajectory are developed to predict the potential velocity gains and the maximum velocity that may be achieved in terms of the lift-to-drag ratio of the vehicle. A lift-generating mechanism is proposed in which power is extracted from the flow over the vehicle in the flight direction and then used to accelerate the surrounding medium in the transverse direction, generating lift. Large values of lift-to-drag ratio are shown to be possible in the case where a small transverse velocity is imparted over a large area of interaction. The requirement for large interaction area in the extremely low density of the heliosphere precludes the use of physical wings, but the use of plasma waves generated by compact, directional antennas to impart momentum on the surrounding medium is feasible, with R-waves, X-waves, Alfven, and magnetosonic waves appearing as promising candidates. A mission is defined in which dynamic soaring is performed on the termination shock of the heliosphere, speeds of 2% of c to be reached within 2.5 years of launch without the expenditure of propellant. The technique may comprise the first stage for a multistage mission to achieve true interstellar flight to other solar systems.


title: A benchmark of first-principles methods for accurate prediction of semiconductor band gaps

abstract: The band gap is an important parameter of semiconductor materials that influences several functional properties, in particular optical properties. However, a fast and reliable first-principles prediction of band gaps remains a challenging problem. Standard DFT approximations tend to strongly underestimate band gaps, while the more accurate $GW$ and hybrid functionals are much more computationally demanding and unsuitable for high-throughput screening. In this work, we have performed an extensive benchmark of several approximations with different computational complexity ($G_{0}W_{0}$@PBEsol, HSE06, PBEsol, mBJ, PBEsol$-1/2$, and ACBN0) to evaluate and compare their performance in predicting the band gap of semiconductors. The benchmark is based on 114 binary semiconductors of different compositions and crystal structures, where about half of them have experimental band gaps. We find that, as expected, $G_{0}W_{0}$@PBEsol performs well relative to the experiment, with a noticeable underestimation of the band gaps by about 14% on average. Surprisingly, $G_{0}W_{0}$@PBEsol is followed closely by the much computationally cheaper pseudo-hybrid ACBN0 functional, showing an excellent performance with respect to experimental data. The meta-GGA mBJ functional also performs well relative to the experiment, even slightly better than $G_{0}W_{0}$@PBEsol in terms of mean absolute (percentage) error. The HSE06 and PBEsol$-1/2$ schemes perform overall worse than ACBN0 and mBJ schemes but much better than PBEsol. Comparing the calculated band gaps on the whole data set (including the samples with no experimental band gap), we find that HSE06 and mBJ have excellent agreement with respect to the reference $G_{0}W_{0}$@PBEsol band gaps. Thus, we propose the mBJ band gaps as economic descriptors when developing artificial intelligence models for high-throughput screening of semiconductor band gaps.


title: Accelerated Riemannian Optimization: Handling Constraints with a Prox to Bound Geometric Penalties

abstract: We propose a globally-accelerated, first-order method for the optimization of smooth and (strongly or not) geodesically-convex functions in a wide class of Hadamard manifolds. We achieve the same convergence rates as Nesterov's accelerated gradient descent, up to a multiplicative geometric penalty and log factors. Crucially, we can enforce our method to stay within a compact set we define. Prior fully accelerated works \emph{resort to assuming} that the iterates of their algorithms stay in some pre-specified compact set, except for two previous methods of limited applicability. For our manifolds, this solves the open question in [KY22] about obtaining global general acceleration without iterates assumptively staying in the feasible set. In our solution, we design an accelerated Riemannian inexact proximal point algorithm, which is a result that was unknown even with exact access to the proximal operator, and is of independent interest. For smooth functions, we show we can implement the prox step inexactly with first-order methods in Riemannian balls of certain diameter that is enough for global accelerated optimization.


title: Towards Improved Input Masking for Convolutional Neural Networks

abstract: The ability to remove features from the input of machine learning models is very important to understand and interpret model predictions. However, this is non-trivial for vision models since masking out parts of the input image typically causes large distribution shifts. This is because the baseline color used for masking (typically grey or black) is out of distribution. Furthermore, the shape of the mask itself can contain unwanted signals which can be used by the model for its predictions. Recently, there has been some progress in mitigating this issue (called missingness bias) in image masking for vision transformers. In this work, we propose a new masking method for CNNs we call layer masking in which the missingness bias caused by masking is reduced to a large extent. Intuitively, layer masking applies a mask to intermediate activation maps so that the model only processes the unmasked input. We show that our method (i) is able to eliminate or minimize the influence of the mask shape or color on the output of the model, and (ii) is much better than replacing the masked region by black or grey for input perturbation based interpretability techniques like LIME. Thus, layer masking is much less affected by missingness bias than other masking strategies. We also demonstrate how the shape of the mask may leak information about the class, thus affecting estimates of model reliance on class-relevant features derived from input masking. Furthermore, we discuss the role of data augmentation techniques for tackling this problem, and argue that they are not sufficient for preventing model reliance on mask shape. The code for this project is publicly available at https://github.com/SriramB-98/layer_masking


title: Hacky Racers: Exploiting Instruction-Level Parallelism to Generate Stealthy Fine-Grained Timers

abstract: Side-channel attacks pose serious threats to many security models, especially sandbox-based browsers. While transient-execution side channels in out-of-order processors have previously been blamed for vulnerabilities such as Spectre and Meltdown, we show that in fact, the capability of out-of-order execution \emph{itself} to cause mayhem is far more general. We develop Hacky Racers, a new type of timing gadget that uses instruction-level parallelism, another key feature of out-of-order execution, to measure arbitrary fine-grained timing differences, even in the presence of highly restricted JavaScript sandbox environments. While such environments try to mitigate timing side channels by reducing timer precision and removing language features such as \textit{SharedArrayBuffer} that can be used to indirectly generate timers via thread-level parallelism, no such restrictions can be designed to limit Hacky Racers. We also design versions of Hacky Racers that require no misspeculation whatsoever, demonstrating that transient execution is not the only threat to security from modern microarchitectural performance optimization. We use Hacky Racers to construct novel \textit{backwards-in-time} Spectre gadgets, which break many hardware countermeasures in the literature by leaking secrets before misspeculation is discovered. We also use them to generate the first known last-level cache eviction set generator in JavaScript that does not require \textit{SharedArrayBuffer} support.


title: Learning Visuo-Haptic Skewering Strategies for Robot-Assisted Feeding

abstract: Acquiring food items with a fork poses an immense challenge to a robot-assisted feeding system, due to the wide range of material properties and visual appearances present across food groups. Deformable foods necessitate different skewering strategies than firm ones, but inferring such characteristics for several previously unseen items on a plate remains nontrivial. Our key insight is to leverage visual and haptic observations during interaction with an item to rapidly and reactively plan skewering motions. We learn a generalizable, multimodal representation for a food item from raw sensory inputs which informs the optimal skewering strategy. Given this representation, we propose a zero-shot framework to sense visuo-haptic properties of a previously unseen item and reactively skewer it, all within a single interaction. Real-robot experiments with foods of varying levels of visual and textural diversity demonstrate that our multimodal policy outperforms baselines which do not exploit both visual and haptic cues or do not reactively plan. Across 6 plates of different food items, our proposed framework achieves 71% success over 69 skewering attempts total. Supplementary material, datasets, code, and videos are available on our website: https://sites.google.com/view/hapticvisualnet-corl22/home


title: Average sensitivity of nested canalizing multivalued functions

abstract: The canalizing properties of biological functions have been mainly studied in the context of Boolean modelling of gene regulatory networks. An important mathematical consequence of canalization is a low average sensitivity, which ensures in particular the expected robustness to noise. In certain situations, the Boolean description is too crude, and it may be necessary to consider functions involving more than two levels of expression. We investigate here the properties of nested canalization for these multivalued functions. We prove that the average sensitivity of nested canalizing multivalued functions is bounded above by a constant. In doing so, we introduce a generalization of nested canalizing multivalued functions, which we call weakly nested canalizing, for which this upper bound holds.


title: Spectral distribution and flux of $\gamma$-ray beams produced through Compton scattering of unsynchronized laser and electron beams

abstract: Intense, quasi-monochromatic, polarized $\gamma$-ray beams produced by Compton scattering of laser photons against relativistic electrons are used for fundamental studies and applications. Following a series of photoneutron cross section measurements in the Giant Dipole Resonance energy region performed at the NewSUBARU synchrotron radiation facility, we have developed the eliLaBr Monte Carlo simulation code for characterization of the scattered $\gamma$-ray photon beams. The code is implemented using Geant4 and is available on the GitHub repository (https://github.com/dan-mihai-filipescu/eliLaBr). Here we report the validation of the eliLaBr code on NewSUBARU LCS $\gamma$-ray beam flux and spectral distribution data and two applications performed with it for asymmetric transverse emittance profiles electron beams, characteristic for synchrotrons. The first application is based on a systematic investigation of transverse collimator offsets relative to the laser and electron beam axis. We show that the maximum energy of the LCS $\gamma$-ray beam is altered by vertical collimator offsets, where the edge shifts towards lower energies with the increase in the offset. Secondly, using the eliLaBr code, we investigate the effect of the laser polarization plane orientation on the properties of the LCS $\gamma$-ray beams produced with asymmetric emittance electron beams. We show that: 1. The use of vertically polarized lasers contributes to the preservation of the LCS $\gamma$-ray beam maximum energy edge by increasing the precision in the vertical collimator alignment. 2. Under identical conditions for the electron and laser beams phase-space distributions, the energy spectrum of the scattered LCS $\gamma$-ray beam changes with the laser beam polarization plane orientation: the use of vertically polarized laser beams slightly deteriorates the LCS $\gamma$-ray beam energy resolution.


title: SliceMatch: Geometry-guided Aggregation for Cross-View Pose Estimation

abstract: This work addresses cross-view camera pose estimation, i.e., determining the 3-Degrees-of-Freedom camera pose of a given ground-level image w.r.t. an aerial image of the local area. We propose SliceMatch, which consists of ground and aerial feature extractors, feature aggregators, and a pose predictor. The feature extractors extract dense features from the ground and aerial images. Given a set of candidate camera poses, the feature aggregators construct a single ground descriptor and a set of pose-dependent aerial descriptors. Notably, our novel aerial feature aggregator has a cross-view attention module for ground-view guided aerial feature selection and utilizes the geometric projection of the ground camera's viewing frustum on the aerial image to pool features. The efficient construction of aerial descriptors is achieved using precomputed masks. SliceMatch is trained using contrastive learning and pose estimation is formulated as a similarity comparison between the ground descriptor and the aerial descriptors. Compared to the state-of-the-art, SliceMatch achieves a 19% lower median localization error on the VIGOR benchmark using the same VGG16 backbone at 150 frames per second, and a 50% lower error when using a ResNet50 backbone.


title: Learning Bimanual Scooping Policies for Food Acquisition

abstract: A robotic feeding system must be able to acquire a variety of foods. Prior bite acquisition works consider single-arm spoon scooping or fork skewering, which do not generalize to foods with complex geometries and deformabilities. For example, when acquiring a group of peas, skewering could smoosh the peas while scooping without a barrier could result in chasing the peas on the plate. In order to acquire foods with such diverse properties, we propose stabilizing food items during scooping using a second arm, for example, by pushing peas against the spoon with a flat surface to prevent dispersion. The added stabilizing arm can lead to new challenges. Critically, this arm should stabilize the food scene without interfering with the acquisition motion, which is especially difficult for easily breakable high-risk food items like tofu. These high-risk foods can break between the pusher and spoon during scooping, which can lead to food waste falling out of the spoon. We propose a general bimanual scooping primitive and an adaptive stabilization strategy that enables successful acquisition of a diverse set of food geometries and physical properties. Our approach, CARBS: Coordinated Acquisition with Reactive Bimanual Scooping, learns to stabilize without impeding task progress by identifying high-risk foods and robustly scooping them using closed-loop visual feedback. We find that CARBS is able to generalize across food shape, size, and deformability and is additionally able to manipulate multiple food items simultaneously. CARBS achieves 87.0% success on scooping rigid foods, which is 25.8% more successful than a single-arm baseline, and reduces food breakage by 16.2% compared to an analytical baseline. Videos can be found at https://sites.google.com/view/bimanualscoop-corl22/home .


title: Toric principal bundles, Tits buildings and reduction of structure group

abstract: A toric principal $G$-bundle is a principal $G$-bundle over a toric variety together with a torus action commuting with the $G$-action. In a recent paper, extending the Klyachko classification of toric vector bundles, Chris Manon and the second author give a classification of toric principal bundles using "piecewise linear maps" to the (extended) Tits building of $G$. In this paper, we use this classification to give a description of the (equivariant) automorphism group of a toric principal bundle as well as a simple criterion for (equivariant) reduction of structure group, recovering results of Dasgupta et al. Finally, motivated by the equivariant splitting problem for toric principal bundles, we introduce the notion of "Helly's number" of a building and pose the problem of giving sharp upper bounds for Helly's number of Tits buildings of semisimple algebraic groups $G$.


title: Unsupervised Wildfire Change Detection based on Contrastive Learning

abstract: The accurate characterization of the severity of the wildfire event strongly contributes to the characterization of the fuel conditions in fire-prone areas, and provides valuable information for disaster response. The aim of this study is to develop an autonomous system built on top of high-resolution multispectral satellite imagery, with an advanced deep learning method for detecting burned area change. This work proposes an initial exploration of using an unsupervised model for feature extraction in wildfire scenarios. It is based on the contrastive learning technique SimCLR, which is trained to minimize the cosine distance between augmentations of images. The distance between encoded images can also be used for change detection. We propose changes to this method that allows it to be used for unsupervised burned area detection and following downstream tasks. We show that our proposed method outperforms the tested baseline approaches.


title: How Crucial is Transformer in Decision Transformer?

abstract: Decision Transformer (DT) is a recently proposed architecture for Reinforcement Learning that frames the decision-making process as an auto-regressive sequence modeling problem and uses a Transformer model to predict the next action in a sequence of states, actions, and rewards. In this paper, we analyze how crucial the Transformer model is in the complete DT architecture on continuous control tasks. Namely, we replace the Transformer by an LSTM model while keeping the other parts unchanged to obtain what we call a Decision LSTM model. We compare it to DT on continuous control tasks, including pendulum swing-up and stabilization, in simulation and on physical hardware. Our experiments show that DT struggles with continuous control problems, such as inverted pendulum and Furuta pendulum stabilization. On the other hand, the proposed Decision LSTM is able to achieve expert-level performance on these tasks, in addition to learning a swing-up controller on the real system. These results suggest that the strength of the Decision Transformer for continuous control tasks may lie in the overall sequential modeling architecture and not in the Transformer per se.


title: Robust fast direct integral equation solver for three-dimensional quasi-periodic scattering problems with a large number of layers

abstract: A boundary integral equation method for the 3-D Helmholtz equation in multilayered media with many quasi-periodic layers is presented. Compared with conventional quasi-periodic Green's function method, the new method is robust at all scattering parameters. A periodizing scheme is used to decompose the solution into near- and far-field contributions. The near-field contribution uses the free-space Green's function in an integral equation on the interface in the unit cell and its immediate eight neighbors; the far-field contribution uses proxy point sources that enclose the unit cell. A specialized high-order quadrature is developed to discretize the underlying surface integral operators to keep the number of unknowns per layer small. We achieve overall linear computational complexity in the number of layers by reducing the linear system into block tridiagonal form and then solving the system directly via block LU decomposition. The new solver is capable of handling a 100-interface structure with 961.3k unknowns to $10^{-5}$ accuracy in less than 2 hours on a desktop workstation.


title: Variational Tensor Neural Networks for Deep Learning

abstract: Deep neural networks (NN) suffer from scaling issues when considering a large number of neurons, in turn limiting also the accessible number of layers. To overcome this, here we propose the integration of tensor networks (TN) into NNs, in combination with variational DMRG-like optimization. This results in a scalable tensor neural network (TNN) architecture that can be efficiently trained for a large number of neurons and layers. The variational algorithm relies on a local gradient-descent technique, with tensor gradients being computable either manually or by automatic differentiation, in turn allowing for hybrid TNN models combining dense and tensor layers. Our training algorithm provides insight into the entanglement structure of the tensorized trainable weights, as well as clarify the expressive power as a quantum neural state. We benchmark the accuracy and efficiency of our algorithm by designing TNN models for regression and classification on different datasets. In addition, we also discuss the expressive power of our algorithm based on the entanglement structure of the neural network.


title: Hardness Results for Minimizing the Covariance of Randomly Signed Sum of Vectors

abstract: Given vectors $\mathbb{v}_1, \ldots, \mathbb{v}_n \in \mathbb{R}^d$ with Euclidean norm at most $1$ and $\mathbb{x}_0 \in [-1,1]^n$, our goal is to sample a random signing $\mathbb{x} \in \{\pm 1\}^n$ with $\mathbb{E}[\mathbb{x}] = \mathbb{x}_0$ such that the operator norm of the covariance of the signed sum of the vectors $\sum_{i=1}^n \mathbb{x}(i) \mathbb{v}_i$ is as small as possible. This problem arises from the algorithmic discrepancy theory and its application in the design of randomized experiments. It is known that one can sample a random signing with expectation $\mathbb{x}_0$ and the covariance operator norm at most $1$. In this paper, we prove two hardness results for this problem. First, we show it is NP-hard to distinguish a list of vectors for which there exists a random signing with expectation ${\bf 0}$ such that the operator norm is $0$ from those for which any signing with expectation ${\bf 0}$ must have the operator norm $\Omega(1)$. Second, we consider $\mathbb{x}_0 \in [-1,1]^n$ whose entries are all around an arbitrarily fixed $p \in [-1,1]$. We show it is NP-hard to distinguish a list of vectors for which there exists a random signing with expectation $\mathbb{x}_0$ such that the operator norm is $0$ from those for which any signing with expectation ${\bf 0}$ must have the operator norm $\Omega((1-|p|)^2)$.


title: Sharp bounds on Helmholtz impedance-to-impedance maps and application to overlapping domain decomposition

abstract: We prove sharp bounds on certain impedance-to-impedance maps (and their compositions) for the Helmholtz equation with large wavenumber (i.e., at high-frequency) using semiclassical defect measures. The paper [GGGLS] (Gong-Gander-Graham-Lafontaine-Spence, 2022) recently showed that the behaviour of these impedance-to-impedance maps (and their compositions) dictates the convergence of the parallel overlapping Schwarz domain-decomposition method with impedance boundary conditions on the subdomain boundaries. For a model decomposition with two subdomains and sufficiently-large overlap, the results of this paper combined with those in [GGGLS] show that the parallel Schwarz method is power contractive, independent of the wavenumber. For strip-type decompositions with many subdomains, the results of this paper show that the composite impedance-to-impedance maps, in general, behave "badly" with respect to the wavenumber; nevertheless, by proving results about the composite maps applied to a restricted class of data, we give insight into the wavenumber-robustness of the parallel Schwarz method observed in the numerical experiments in [GGGLS].


title: The role of boundaries for displacements and motion in two-dimensional fluid or elastic films and membranes

abstract: Thin fluid or elastic films and membranes are found in nature and technology, for instance, as confinements of living cells or in loudspeakers. When applying a net force, resulting flows in an unbounded two-dimensional incompressible low-Reynolds-number fluid or displacements in a two-dimensional linearly elastic solid seem to diverge logarithmically with the distance from the force center, which has led to some debate. Recently, we have demonstrated that such divergences cancel when the total (net) force vanishes. Here, we illustrate that, if a net force is present, the boundaries play a prominent role. Already a single no-slip boundary regulates the flow and displacement fields and leads to their decay to leading order inversely in distance from a force center and the boundary. In other words, it is the boundary that stabilizes the system in this situation, unlike the three-dimensional case, where an unbounded medium by itself is able to absorb a net force. We quantify the mobility and displaceability of an inclusion as a function of the distance from the boundary, as well as interactions between different inclusions. In the case of free-slip boundary conditions, a kinked boundary is necessary to achieve stabilization.

categories: cond-mat.soft cond-mat.mtrl-sci physics.bio-ph physics.flu-dyn


title: Iterated Function Systems: A Comprehensive Survey

abstract: We provide an overview of iterated function systems (IFS), where randomly chosen state-to-state maps are applied iteratively to a state. We aim to summarize the state of art and, where possible, identify fundamental challenges and opportunities for further research.


title: 3D Reconstruction of Protein Complex Structures Using Synthesized Multi-View AFM Images

abstract: Recent developments in deep learning-based methods demonstrated its potential to predict the 3D protein structures using inputs such as protein sequences, Cryo-Electron microscopy (Cryo-EM) images of proteins, etc. However, these methods struggle to predict the protein complexes (PC), structures with more than one protein. In this work, we explore the atomic force microscope (AFM) assisted deep learning-based methods to predict the 3D structure of PCs. The images produced by AFM capture the protein structure in different and random orientations. These multi-view images can help train the neural network to predict the 3D structure of protein complexes. However, obtaining the dataset of actual AFM images is time-consuming and not a pragmatic task. We propose a virtual AFM imaging pipeline that takes a 'PDB' protein file and generates multi-view 2D virtual AFM images using volume rendering techniques. With this, we created a dataset of around 8K proteins. We train a neural network for 3D reconstruction called Pix2Vox++ using the synthesized multi-view 2D AFM images dataset. We compare the predicted structure obtained using a different number of views and get the intersection over union (IoU) value of 0.92 on the training dataset and 0.52 on the validation dataset. We believe this approach will lead to better prediction of the structure of protein complexes.


title: Computational Co-Design for Variable Geometry Truss

abstract: Living creatures and machines interact with the world through their morphology and motions. Recent advances in creating bio-inspired morphing robots and machines have led to the study of variable geometry truss (VGT), structures that can approximate arbitrary geometries and has large degree of freedom to deform. However, they are limited to simple geometries and motions due to the excessively complex control system. While a recent work PneuMesh solves this challenge with a novel VGT design that introduces a selective channel connection strategy, it imposes new challenge in identifying effective channel groupings and control methods. Building on top of the hardware concept presented in PneuMesh, we frame the challenge into a co-design problem and introduce a learning-based model to find a sub-optimal design. Specifically, given an initial truss structure provided by a human designer, we first adopt a genetic algorithm (GA) to optimize the channel grouping, and then couple GA with reinforcement learning (RL) for the control. The model is tailored to the PneuMesh system with customized initialization, mutation and selection functions, as well as the customized translation-invariant state vector for reinforcement learning. The result shows that our method enables a robotic table-based VGT to achieve various motions with a limited number of control inputs. The table is trained to move, lower its body or tilt its tabletop to accommodate multiple use cases such as benefiting kids and painters to use it in different shape states, allowing inclusive and adaptive design through morphing trusses.


title: Lower Bounds on Retroactive Data Structures

abstract: We prove essentially optimal fine-grained lower bounds on the gap between a data structure and a partially retroactive version of the same data structure. Precisely, assuming any one of three standard conjectures, we describe a problem that has a data structure where operations run in $O(T(n,m))$ time per operation, but any partially retroactive version of that data structure requires $T(n,m) \cdot m^{1-o(1)}$ worst-case time per operation, where $n$ is the size of the data structure at any time and $m$ is the number of operations. Any data structure with operations running in $O(T(n,m))$ time per operation can be converted (via the "rollback method") into a partially retroactive data structure running in $O(T(n,m) \cdot m)$ time per operation, so our lower bound is tight up to an $m^{o(1)}$ factor common in fine-grained complexity.


title: Algebraic dependence and Milnor K-theory

abstract: This paper shows that algebraic (in)dependence is encoded in Milnor K-theory of fields. As an application, we show that the isomorphism type of a field is determined by its Milnor K-theory, up to purely inseparable extensions, in most situations.


title: Synergies between Disentanglement and Sparsity: Generalization and Identifiability in Multi-Task Learning

abstract: Although disentangled representations are often said to be beneficial for downstream tasks, current empirical and theoretical understanding is limited. In this work, we provide evidence that disentangled representations coupled with sparse base-predictors improve generalization. In the context of multi-task learning, we prove a new identifiability result that provides conditions under which maximally sparse base-predictors yield disentangled representations. Motivated by this theoretical result, we propose a practical approach to learn disentangled representations based on a sparsity-promoting bi-level optimization problem. Finally, we explore a meta-learning version of this algorithm based on group Lasso multiclass SVM base-predictors, for which we derive a tractable dual formulation. It obtains competitive results on standard few-shot classification benchmarks, while each task is using only a fraction of the learned representations.


title: Deep Fake Detection, Deterrence and Response: Challenges and Opportunities

abstract: According to the 2020 cyber threat defence report, 78% of Canadian organizations experienced at least one successful cyberattack in 2020. The consequences of such attacks vary from privacy compromises to immersing damage costs for individuals, companies, and countries. Specialists predict that the global loss from cybercrime will reach 10.5 trillion US dollars annually by 2025. Given such alarming statistics, the need to prevent and predict cyberattacks is as high as ever. Our increasing reliance on Machine Learning(ML)-based systems raises serious concerns about the security and safety of these systems. Especially the emergence of powerful ML techniques to generate fake visual, textual, or audio content with a high potential to deceive humans raised serious ethical concerns. These artificially crafted deceiving videos, images, audio, or texts are known as Deepfakes garnered attention for their potential use in creating fake news, hoaxes, revenge porn, and financial fraud. Diversity and the widespread of deepfakes made their timely detection a significant challenge. In this paper, we first offer background information and a review of previous works on the detection and deterrence of deepfakes. Afterward, we offer a solution that is capable of 1) making our AI systems robust against deepfakes during development and deployment phases; 2) detecting video, image, audio, and textual deepfakes; 3) identifying deepfakes that bypass detection (deepfake hunting); 4) leveraging available intelligence for timely identification of deepfake campaigns launched by state-sponsored hacking teams; 5) conducting in-depth forensic analysis of identified deepfake payloads. Our solution would address important elements of the Canada National Cyber Security Action Plan(2019-2024) in increasing the trustworthiness of our critical services.


title: A Maximum Log-Likelihood Method for Imbalanced Few-Shot Learning Tasks

abstract: Few-shot learning is a rapidly evolving area of research in machine learning where the goal is to classify unlabeled data with only one or "a few" labeled exemplary samples. Neural networks are typically trained to minimize a distance metric between labeled exemplary samples and a query set. Early few-shot approaches use an episodic training process to sub-sample the training data into few-shot batches. This training process matches the sub-sampling done on evaluation. Recently, conventional supervised training coupled with a cosine distance has achieved superior performance for few-shot. Despite the diversity of few-shot approaches over the past decade, most methods still rely on the cosine or Euclidean distance layer between the latent features of the trained network. In this work, we investigate the distributions of trained few-shot features and demonstrate that they can be roughly approximated as exponential distributions. Under this assumption of an exponential distribution, we propose a new maximum log-likelihood metric for few-shot architectures. We demonstrate that the proposed metric achieves superior performance accuracy w.r.t. conventional similarity metrics (e.g., cosine, Euclidean, etc.), and achieve state-of-the-art inductive few-shot performance. Further, additional gains can be achieved by carefully combining multiple metrics and neither of our methods require post-processing feature transformations, which are common to many algorithms. Finally, we demonstrate a novel iterative algorithm designed around our maximum log-likelihood approach that achieves state-of-the-art transductive few-shot performance when the evaluation data is imbalanced. We have made our code publicly available at https://github.com/samuelhess/MLL_FSL/.


title: Game Theoretic Mixed Experts for Combinational Adversarial Machine Learning

abstract: Recent advances in adversarial machine learning have shown that defenses considered to be robust are actually susceptible to adversarial attacks which are specifically customized to target their weaknesses. These defenses include Barrage of Random Transforms (BaRT), Friendly Adversarial Training (FAT), Trash is Treasure (TiT) and ensemble models made up of Vision Transformers (ViTs), Big Transfer models and Spiking Neural Networks (SNNs). We first conduct a transferability analysis, to demonstrate the adversarial examples generated by customized attacks on one defense, are not often misclassified by another defense. This finding leads to two important questions. First, how can the low transferability between defenses be utilized in a game theoretic framework to improve the robustness? Second, how can an adversary within this framework develop effective multi-model attacks? In this paper, we provide a game-theoretic framework for ensemble adversarial attacks and defenses. Our framework is called Game theoretic Mixed Experts (GaME). It is designed to find the Mixed-Nash strategy for both a detector based and standard defender, when facing an attacker employing compositional adversarial attacks. We further propose three new attack algorithms, specifically designed to target defenses with randomized transformations, multi-model voting schemes, and adversarial detector architectures. These attacks serve to both strengthen defenses generated by the GaME framework and verify their robustness against unforeseen attacks. Overall, our framework and analyses advance the field of adversarial machine learning by yielding new insights into compositional attack and defense formulations.


title: Mediated Cheap Talk Design (with proofs)

abstract: We study an information design problem with two informed senders and a receiver in which, in contrast to traditional Bayesian persuasion settings, senders do not have commitment power. In our setting, a trusted mediator/platform gathers data from the senders and recommends the receiver which action to play. We characterize the set of implementable action distributions that can be obtained in equilibrium, and provide an $O(n \log n)$ algorithm (where $n$ is the number of states) that computes the optimal equilibrium for the senders. Additionally, we show that the optimal equilibrium for the receiver can be obtained by a simple revelation mechanism.


title: Efficient Targeted Learning of Heterogeneous Treatment Effects for Multiple Subgroups

abstract: In biomedical science, analyzing treatment effect heterogeneity plays an essential role in assisting personalized medicine. The main goals of analyzing treatment effect heterogeneity include estimating treatment effects in clinically relevant subgroups and predicting whether a patient subpopulation might benefit from a particular treatment. Conventional approaches often evaluate the subgroup treatment effects via parametric modeling and can thus be susceptible to model mis-specifications. In this manuscript, we take a model-free semiparametric perspective and aim to efficiently evaluate the heterogeneous treatment effects of multiple subgroups simultaneously under the one-step targeted maximum-likelihood estimation (TMLE) framework. When the number of subgroups is large, we further expand this path of research by looking at a variation of the one-step TMLE that is robust to the presence of small estimated propensity scores in finite samples. From our simulations, our method demonstrates substantial finite sample improvements compared to conventional methods. In a case study, our method unveils the potential treatment effect heterogeneity of rs12916-T allele (a proxy for statin usage) in decreasing Alzheimer's disease risk.


title: Multi-Transmitter Coded Caching with Secure Delivery over Linear Networks -- Extended Version

abstract: In this paper, we consider multiple cache-enabled end-users connected to multiple transmitters through a linear network. We also prevent a totally passive eavesdropper, who sniffs the packets in the delivery phase, from obtaining any information about the original files in cache-aided networks. Three different secure centralized multi-transmitter coded caching scenarios namely, secure multi-transmitter coded caching, secure multi-transmitter coded caching with reduced subpacketization, and secure multi-transmitter coded caching with reduced feedback, are considered and closed-form coding delay and secret shared key storage expressions are provided. As our security guarantee, we show that the delivery phase does not reveal any information to the eavesdropper using the mutual information metric. Moreover, we investigate the secure decentralized multi-transmitter coded caching scenario, in which there is no cooperation between the clients and transmitters during the cache content placement phase and study its performance compared to the centralized scheme. We analyze the system's performance in terms of Coding Delay and guarantee the security of our presented schemes using the Mutual Information metric. Numerical evaluations verify that security incurs a negligible cost in terms of memory usage when the number of files and users are scaled up, in both centralized and decentralized scenarios. Also, we numerically show that by increasing the number of files and users, the secure coding delay of centralized and decentralized schemes became asymptotically equal.


title: Evaluation Beyond Task Performance: Analyzing Concepts in AlphaZero in Hex

abstract: AlphaZero, an approach to reinforcement learning that couples neural networks and Monte Carlo tree search (MCTS), has produced state-of-the-art strategies for traditional board games like chess, Go, shogi, and Hex. While researchers and game commentators have suggested that AlphaZero uses concepts that humans consider important, it is unclear how these concepts are captured in the network. We investigate AlphaZero's internal representations in the game of Hex using two evaluation techniques from natural language processing (NLP): model probing and behavioral tests. In doing so, we introduce new evaluation tools to the RL community and illustrate how evaluations other than task performance can be used to provide a more complete picture of a model's strengths and weaknesses. Our analyses in the game of Hex reveal interesting patterns and generate some testable hypotheses about how such models learn in general. For example, we find that MCTS discovers concepts before the neural network learns to encode them. We also find that concepts related to short-term end-game planning are best encoded in the final layers of the model, whereas concepts related to long-term planning are encoded in the middle layers of the model.


title: Quarkyonic or baryquark matter? On the dynamical generation of momentum space shell structure

abstract: We study the equation of state of a mixture of (quasi-)free constituent quarks and nucleons with hard-core repulsion at zero temperature. Two opposite scenarios for the realization of the Pauli exclusion principle are considered: (i) a Fermi sea of quarks surrounded by a shell of baryons -- the quarkyonic matter, and (ii) a Fermi sea of nucleons surrounded by a shell of quarks which we call \emph{baryquark matter}. In both scenarios, the sizes of the Fermi sea and shell are fixed through energy minimization at fixed baryon number density. While both cases yield a qualitatively similar transition from hadronic to quark matter, we find that baryquark matter is energetically favored in this setup and yields a physically acceptable behavior of the speed of sound without the need to introduce an infrared regulator. In order to retain the theoretically more appealing quarkyonic matter as the preferred form of dense QCD matter will thus require modifications to the existing dynamical generation mechanisms, such as, for example, the introduction of momentum-dependent nuclear interactions.


title: Parsimonious cones

abstract: We construct embeddings of simplicial complexes into a (surface of a) simplicial ball whose triangulation has bounded degrees and low volume. This construction can be used either to efficiently "simplify a complicated space" by realizing it as a part of a ball/sphere, or to "complexify" a sphere - to give it a specific metric that inherits desired properties from an embedded complex.


title: Maximizing the Probability of Fixation in the Positional Voter Model

abstract: The Voter model is a well-studied stochastic process that models the invasion of a novel trait $A$ (e.g., a new opinion, social meme, genetic mutation, magnetic spin) in a network of individuals (agents, people, genes, particles) carrying an existing resident trait $B$. Individuals change traits by occasionally sampling the trait of a neighbor, while an invasion bias $\delta\geq 0$ expresses the stochastic preference to adopt the novel trait $A$ over the resident trait $B$. The strength of an invasion is measured by the probability that eventually the whole population adopts trait $A$, i.e., the fixation probability. In more realistic settings, however, the invasion bias is not ubiquitous, but rather manifested only in parts of the network. For instance, when modeling the spread of a social trait, the invasion bias represents localized incentives. In this paper, we generalize the standard biased Voter model to the positional Voter model, in which the invasion bias is effectuated only on an arbitrary subset of the network nodes, called biased nodes. We study the ensuing optimization problem, which is, given a budget $k$, to choose $k$ biased nodes so as to maximize the fixation probability of a randomly occurring invasion. We show that the problem is NP-hard both for finite $\delta$ and when $\delta \rightarrow \infty$ (strong bias), while the objective function is not submodular in either setting, indicating strong computational hardness. On the other hand, we show that, when $\delta\rightarrow 0$ (weak bias), we can obtain a tight approximation in $O(n^{2\omega})$ time, where $\omega$ is the matrix-multiplication exponent. We complement our theoretical results with an experimental evaluation of some proposed heuristics.


title: Impacts of magnetic permeability on electromagnetic data collected in settings with steel-cased wells

abstract: Electromagnetic methods are increasingly being applied in settings with steel infrastructure. These include applications such as monitoring of CO2 sequestration or even assessing the integrity of a wellbore. In this paper, we examine the impacts of the magnetic permeability of a steel-cased well on electromagnetic responses in grounded source experiments. We consider a vertical wellbore and simulate time and frequency domain data on 3D cylindrical meshes. Permeability slows the decay of surface electric fields in the time domain and contributes to a phase shift in the frequency domain. We develop our understanding of how permeability alters currents within, and external to, the casing by focussing first on the time domain response and translating insights to the frequency domain. Following others, we rewrite Maxwell's equations to separate the response into terms that describe the magnetization and induction effects. Magnetic permeability impacts the responses in two ways: (1) it enhances the inductive component of the response in the casing, and (2) it creates a magnetization current on the outer wall of the casing. The interaction of these two effects results in a poloidal current system within the casing. It also generates anomalous currents external to the casing that can alter the geometry and magnitude of currents in the surrounding geologic formation. This has the potential to be advantageous for enhancing responses in monitoring applications.


title: A new upper bound to (a variant of) the pancake problem

abstract: The "pancake problem" asks how many prefix reversals are sufficient to sort any permutation $\pi \in \mathcal{S}_k$ to the identity. We write $f(k)$ to denote this quantity. The best known bounds are that $\frac{15}{14}k -O(1) \le f(k)\le \frac{18}{11}k+O(1)$. The proof of the upper bound is computer-assisted, and considers thousands of cases. We consider $h(k)$, how many prefix and suffix reversals are sufficient to sort any $\pi \in \mathcal{S}_k$. We observe that $\frac{15}{14}k -O(1)\le h(k)$ still holds, and give a human proof that $h(k) \le \frac{3}{2}k +O(1)$. The constant "$\frac{3}{2}$" is a natural barrier for the pancake problem and this variant, hence new techniques will be required to do better.


title: Exact Results for the Residual Entropy of Ice Hexagonal Monolayer

abstract: Since the problem of the residual entropy of square ice was exactly solved, exact solutions for two-dimensional realistic ice models have been of interest. In this paper, we study the exact residual entropy of ice hexagonal monolayer in two cases. In the case that the external electric field along the z-axis exists, we map the hydrogen configurations into the spin configurations of the Ising model on the Kagom\'e lattice. By taking the low temperature limit of the Ising model, we derive the exact residual entropy, which agrees with the result determined previously from the dimer model on the honeycomb lattice. In another case that the ice hexagonal monolayer is under the periodic boundary conditions in the cubic ice lattice, we employ the six-vertex model on the square lattice to represent the hydrogen configurations obeying the ice rules. The exact residual entropy in this case is obtained from the solution of the equivalent six-vertex model. Our work provides more examples of the exactly soluble two-dimensional models.


title: A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstruction

abstract: Machine learning models are gaining increasing popularity in the domain of fluid dynamics for their potential to accelerate the production of high-fidelity computational fluid dynamics data. However, many recently proposed machine learning models for high-fidelity data reconstruction require low-fidelity data for model training. Such requirement restrains the application performance of these models, since their data reconstruction accuracy would drop significantly if the low-fidelity input data used in model test has a large deviation from the training data. To overcome this restraint, we propose a diffusion model which only uses high-fidelity data at training. With different configurations, our model is able to reconstruct high-fidelity data from either a regular low-fidelity sample or a sparsely measured sample, and is also able to gain an accuracy increase by using physics-informed conditioning information from a known partial differential equation when that is available. Experimental results demonstrate that our model can produce accurate reconstruction results for 2d turbulent flows based on different input sources without retraining.


title: Strongly $\phi$-flat modules, strongly nonnil-injective modules and their homological dimensions

abstract: In this paper, we first introduce and study the notions of strongly $\phi$-flat modules and strongly nonnil-injective modules. And then, we investigate the homology dimensions of modules and rings in terms of these two notions. Finally we give a new homological characterizations of $\phi$-Dedekind rings and $\phi$-\Prufer\ rings.


title: Local Statistics and Shuffling for Dimers on a Square-Hexagon Lattice

abstract: We study the dimer model on special subgraphs of the square hexagon lattice called "tower graphs" of size $N$. Using integrable probability techniques, we confirm that as $N \rightarrow \infty$, the local statistics are translation invariant Gibbs measures, as conjectured by Kenyon-Okounkov-Sheffield. We also present a 2+1-dimensional discrete time growth process, whose time $N$ distribution is exactly the dimer model on the size $N$ tower, and we compute the current of this growth process and confirm that the model belongs to the Anisotropic KPZ universality class.


title: Utility of PCA and Other Data Transformation Techniques in Exoplanet Research

abstract: This paper focuses on the utility of various data transformation techniques, which might be under the principal component analysis (PCA) category, on exoplanet research. The first section introduces the methodological background of PCA and related techniques. The second section reviews the studies which utilized these techniques in the exoplanet research field and compiles the focuses in the literature under different items in the overview, with future research direction recommendations at the end.


title: A sharper Swiss cheese

abstract: It is shown that there exists a compact planar set K such that the uniform algebra R(K) is nontrivial and strongly regular. This settles an issue raised by Donald Wilken 54 years ago. It is shown that the set K can be chosen such that, in addition, R(K) is not weakly amenable. It is also shown that there exists a uniform algebra that has bounded relative units but is not weakly amenable. These results answer questions raised by Joel Feinstein and Matthew Heath 16 years ago. A key ingredient in our proofs is a bound we establish on the functions introduced by Koerner to simplify McKissick's construction of a normal uniform algebra.


title: Large and Versatile Plasmonic Enhancement of Photoluminescence Using Colloidal Metallic Nanocubes

abstract: Improving phosphor photoluminescence efficiency is a key parameter to boost the performances of many optical devices. In this work, colloidal silver nanocubes, homogeneously spread on a luminescent surface, have proved to help both injecting and extracting light in and out of the photoluminescent layer and hence contributed significantly to the enhancement of the fluorescence. This approach has been applied to two materials: the well-known Y$_3$Al$_5$O$_{12}$:Ce yellow phosphor and an optical quartz. The emission efficiency, for sol-gel derived YAG:Ce layers, has increased of 80\% in the presence of an optimal nanoparticle density -- whereas for quartz, a weakly fluorescent material, the photoluminescence signal can be enhanced by a 200-fold factor. A physical analysis based on simulations shows that the disorder is an important factor and that the surface density of Ag nanoparticles is a crucial parameter.


title: Towards a Decentralized Metaverse: Synchronized Orchestration of Digital Twins and Sub-Metaverses

abstract: Accommodating digital twins (DTs) in the metaverse is essential to achieving digital reality. This need for integrating DTs into the metaverse while operating them at the network edge has increased the demand for a decentralized edge-enabled metaverse. Hence, to consolidate the fusion between real and digital entities, it is necessary to harmonize the interoperability between DTs and the metaverse at the edge. In this paper, a novel decentralized metaverse framework that incorporates DT operations at the wireless edge is presented. In particular, a system of autonomous physical twins (PTs) operating in a massively-sensed zone is replicated as cyber twins (CTs) at the mobile edge computing (MEC) servers. To render the CTs' digital environment, this zone is partitioned and teleported as distributed sub-metaverses to the MEC servers. To guarantee seamless synchronization of the sub-metaverses and their associated CTs with the dynamics of the real world and PTs, respectively, this joint synchronization problem is posed as an optimization problem whose goal is to minimize the average sub-synchronization time between the real and digital worlds, while meeting the DT synchronization intensity requirements. To solve this problem, a novel iterative algorithm for joint sub-metaverse and DT association at the MEC servers is proposed. This algorithm exploits the rigorous framework of optimal transport theory so as to efficiently distribute the sub-metaverses and DTs, while considering the computing and communication resource allocations. Simulation results show that the proposed solution can orchestrate the interplay between DTs and sub-metaverses to achieve a 25.75 % reduction in the sub-synchronization time in comparison to the signal-to-noise ratio-based association scheme.


title: Cutoff for the non reversible SSEP with reservoirs

abstract: We consider the Symmetric Simple Exclusion Process (SSEP) on the segment with two reservoirs of densities $p, q \in (0,1)$ at the two endpoints. We show that the system exhibits cutoff with a diffusive window, thus confirming a conjecture of Gantert, Nestoridi, and Schmid in \cite{Gantert2020}. In particular, our result covers the regime $p \neq q$, where the process is not reversible and there is no known explicit formula for the invariant measure. Our proof exploits the information percolation framework introduced by Lubetzky and Sly, the negative dependence of the system, and an anticoncentration inequality at the conditional level. We believe this approach is applicable to other models.


title: High-throughput ab initio reaction mechanism exploration in the cloud with automated multi-reference validation

abstract: Quantum chemical calculations on atomistic systems have evolved into a standard approach to study molecular matter. These calculations often involve a significant amount of manual input and expertise although most of this effort could be automated, which would alleviate the need for expertise in software and hardware accessibility. Here, we present the AutoRXN workflow, an automated workflow for exploratory high-throughput lectronic structure calculations of molecular systems, in which (i) density functional theory methods are exploited to deliver minimum and transition-state structures and corresponding energies and properties, (ii) coupled cluster calculations are then launched for optimized structures to provide more accurate energy and property estimates, and (iii) multi-reference diagnostics are evaluated to back check the coupled cluster results and subject hem to automated multi-configurational calculations for potential multi-configurational cases. All calculations are carried out in a cloud environment and support massive computational campaigns. Key features of all omponents of the AutoRXN workflow are autonomy, stability, and minimum operator interference. We highlight the AutoRXN workflow at the example of an autonomous reaction mechanism exploration of the mode of action of a homogeneous catalyst for the asymmetric reduction of ketones.


title: A buckling question

abstract: Although it is often asserted that, in view of their reduced length, axially compressible beams have a higher buckling load than their inextensible counterpart, a detailed analysis demnstrates that this is not necessarily the case. The argument to arrive at this conclusion is made in terms of relatively straightforward concepts of elasticity and structural mechanics. It is shown that for certain classes of materials the reduced pre-buckling length is more than compensated by a softening of the elastic response, leading to a reduction of the Euler critical load.


title: Cylindrical contact homology of links of simple singularities (V2)

abstract: We compute the cylindrical contact homology of the links of the simple singularities. These manifolds are contactomorphic to $S^3/G$ for finite subgroups $G\subset\text{SU}(2)$. We perturb the degenerate contact form on $S^3/G$ with a Morse function, invariant under the corresponding $H\subset\text{SO}(3)$ action on $S^2$, to achieve nondegeneracy up to an action threshold. The cylindrical contact homology is recovered by taking a direct limit of the action filtered homology groups. The ranks of this homology are given in terms of $|\text{Conj}(G)|$, demonstrating a form of the McKay correspondence.


title: Detecting Changes in the Transmission Rate of a Stochastic Epidemic Model

abstract: Throughout the course of an epidemic, the rate at which disease spreads varies with behavioral changes, the emergence of new disease variants, and the introduction of mitigation policies. Estimating such changes in transmission rates can help us better model and predict the dynamics of an epidemic, and provide insight into the efficacy of control and intervention strategies. We present a method for likelihood-based estimation of parameters in the stochastic SIR model under a time-inhomogeneous transmission rate comprised of piecewise constant components. In doing so, our method simultaneously learns change points in the transmission rate via a Markov chain Monte Carlo algorithm. The method targets the exact model posterior in a difficult missing data setting given only partially observed case counts over time. We validate performance on simulated data before applying our approach to data from an Ebola outbreak in Western Africa and COVID-19 outbreak on a university campus.


title: Radial Neighbors for Provably Accurate Scalable Approximations of Gaussian Processes

abstract: In geostatistical problems with massive sample size, Gaussian processes can be approximated using sparse directed acyclic graphs to achieve scalable $O(n)$ computational complexity. In these models, data at each location are typically assumed conditionally dependent on a small set of parents which usually include a subset of the nearest neighbors. These methodologies often exhibit excellent empirical performance, but the lack of theoretical validation leads to unclear guidance in specifying the underlying graphical model and sensitivity to graph choice. We address these issues by introducing radial neighbors Gaussian processes (RadGP), a class of Gaussian processes based on directed acyclic graphs in which directed edges connect every location to all of its neighbors within a predetermined radius. We prove that any radial neighbors Gaussian process can accurately approximate the corresponding unrestricted Gaussian process in Wasserstein-2 distance, with an error rate determined by the approximation radius, the spatial covariance function, and the spatial dispersion of samples. We offer further empirical validation of our approach via applications on simulated and real world data showing excellent performance in both prior and posterior approximations to the original Gaussian process.


title: E-infinity structures over L-algebras

abstract: In this paper we introduce the concept of L-algebras, which can be seen as a generalization of the structure determined by the Eilenberg-Mac lane transformation and Alexander-Whitney diagonal in chain complexes. In this sense, our main result states that L-algebras are endowed with an E-infinity coalgebra struture, like the one determined by the Barrat-Eccles operad in chain complexes. This results implies that the canonical L-algebra of spaces contains as much homotopy information as its usually associated E-infinity coalgebras, suggesting L-algebras as a tool for the study of homotopy types.


title: DigGAN: Discriminator gradIent Gap Regularization for GAN Training with Limited Data

abstract: Generative adversarial nets (GANs) have been remarkably successful at learning to sample from distributions specified by a given dataset, particularly if the given dataset is reasonably large compared to its dimensionality. However, given limited data, classical GANs have struggled, and strategies like output-regularization, data-augmentation, use of pre-trained models and pruning have been shown to lead to improvements. Notably, the applicability of these strategies is 1) often constrained to particular settings, e.g., availability of a pretrained GAN; or 2) increases training time, e.g., when using pruning. In contrast, we propose a Discriminator gradIent Gap regularized GAN (DigGAN) formulation which can be added to any existing GAN. DigGAN augments existing GANs by encouraging to narrow the gap between the norm of the gradient of a discriminator's prediction w.r.t.\ real images and w.r.t.\ the generated samples. We observe this formulation to avoid bad attractors within the GAN loss landscape, and we find DigGAN to significantly improve the results of GAN training when limited data is available. Code is available at \url{https://github.com/AilsaF/DigGAN}.


title: Transport noise restores uniqueness and prevents blow-up in geometric transport equations

abstract: In this work, we demonstrate well-posedness and regularisation by noise results for a class of geometric transport equations that contains, among others, the linear transport and continuity equations. This class is known as linear advection of $k$-forms. In particular, we prove global existence and uniqueness of $L^p$-solutions to the stochastic equation, driven by a spatially $\alpha$-H\"older drift $b$, uniformly bounded in time, with an integrability condition on the distributional derivative of $b$, and sufficiently regular diffusion vector fields. Furthermore, we prove that all our solutions are continuous if the initial datum is continuous. Finally, we show that our class of equations without noise admits infinitely many $L^p$-solutions and is hence ill-posed. Moreover, the deterministic solutions can be discontinuous in both time and space independently of the regularity of the initial datum. We also demonstrate that for certain initial data of class $C^\infty_{0},$ the deterministic $L^p$-solutions blow up instantaneously in the space $L^{\infty}_{loc}$. In order to establish our results, we employ characteristics-based techniques that exploit the geometric structure of our equations.


title: Colimites en la categor\'ia de operads sim\'etricos

abstract: In this article we present a detailed study of the existing constructions of colilimits in the category of symmetrical operations. In addition, some examples of operads obtained from colimits of other operads are presented.


title: Topological Bonding and Electronic properties of Cd$_{43}$Te$_{28}$ semiconductor material with microporous structure

abstract: CdTe is II-VI semiconductor material with excellent characteristics and has demonstrated promising potential for application in the photovoltaic field. The electronic properties of Cd43Te28 with microporous structures have been investigated based on density functional theory. The newly established binding-energy and bond-charge model have been used to convert the value of Hamiltonian into bonding values. We provide a method for describing topological chemical bonds by atomic coordinates and wave phases. We also discuss the dynamic process of the wave function with time and the magic cube matrix. This study provides an innovative method and technology for the accurate analysis of the topological bonding and electronic properties of microporous semiconductor materials.


title: Reconciling model-X and doubly robust approaches to conditional independence testing

abstract: Model-X approaches to testing conditional independence between a predictor and an outcome variable given a vector of covariates usually assume exact knowledge of the conditional distribution of the predictor given the covariates. Nevertheless, model-X methodologies are often deployed with this conditional distribution learned in sample. We investigate the consequences of this choice through the lens of the distilled conditional randomization test (dCRT). We find that Type-I error control is still possible, but only if the mean of the outcome variable given the covariates is estimated well enough. This demonstrates that the dCRT is doubly robust, and motivates a comparison to the generalized covariance measure (GCM) test, another doubly robust conditional independence test. We prove that these two tests are asymptotically equivalent, and show that the GCM test is optimal against (generalized) partially linear alternatives by leveraging semiparametric efficiency theory. In an extensive simulation study, we compare the dCRT to the GCM test. These two tests have broadly similar Type-I error and power, though dCRT can have somewhat better Type-I error control but somewhat worse power in small samples or when the response is discrete. We also find that post-lasso based test statistics (as compared to lasso based statistics) can dramatically improve Type-I error control for both methods.


title: A Theoretical Study of Inductive Biases in Contrastive Learning

abstract: Understanding self-supervised learning is important but challenging. Previous theoretical works study the role of pretraining losses, and view neural networks as general black boxes. However, the recent work of Saunshi et al. argues that the model architecture -- a component largely ignored by previous works -- also has significant influences on the downstream performance of self-supervised learning. In this work, we provide the first theoretical analysis of self-supervised learning that incorporates the effect of inductive biases originating from the model class. In particular, we focus on contrastive learning -- a popular self-supervised learning method that is widely used in the vision domain. We show that when the model has limited capacity, contrastive representations would recover certain special clustering structures that are compatible with the model architecture, but ignore many other clustering structures in the data distribution. As a result, our theory can capture the more realistic setting where contrastive representations have much lower dimensionality than the number of clusters in the data distribution. We instantiate our theory on several synthetic data distributions, and provide empirical evidence to support the theory.


title: A novel multimodal dynamic fusion network for disfluency detection in spoken utterances

abstract: Disfluency, though originating from human spoken utterances, is primarily studied as a uni-modal text-based Natural Language Processing (NLP) task. Based on early-fusion and self-attention-based multimodal interaction between text and acoustic modalities, in this paper, we propose a novel multimodal architecture for disfluency detection from individual utterances. Our architecture leverages a multimodal dynamic fusion network that adds minimal parameters over an existing text encoder commonly used in prior art to leverage the prosodic and acoustic cues hidden in speech. Through experiments, we show that our proposed model achieves state-of-the-art results on the widely used English Switchboard for disfluency detection and outperforms prior unimodal and multimodal systems in literature by a significant margin. In addition, we make a thorough qualitative analysis and show that, unlike text-only systems, which suffer from spurious correlations in the data, our system overcomes this problem through additional cues from speech signals. We make all our codes publicly available on GitHub.


title: Spatio-Temporal Meta-Graph Learning for Traffic Forecasting

abstract: Traffic forecasting as a canonical task of multivariate time series forecasting has been a significant research topic in AI community. To address the spatio-temporal heterogeneity and non-stationarity implied in the traffic stream, in this study, we propose Spatio-Temporal Meta-Graph Learning as a novel Graph Structure Learning mechanism on spatio-temporal data. Specifically, we implement this idea into Meta-Graph Convolutional Recurrent Network (MegaCRN) by plugging the Meta-Graph Learner powered by a Meta-Node Bank into GCRN encoder-decoder. We conduct a comprehensive evaluation on two benchmark datasets (i.e., METR-LA and PEMS-BAY) and a new large-scale traffic speed dataset called EXPY-TKY that covers 1843 expressway road links in Tokyo. Our model outperformed the state-of-the-arts on all three datasets. Besides, through a series of qualitative evaluations, we demonstrate that our model can explicitly disentangle the road links and time slots with different patterns and be robustly adaptive to any anomalous traffic situations. Codes and datasets are available at https://github.com/deepkashiwa20/MegaCRN.


title: Bilinear forms with trace functions over arbitrary sets, and applications to Sato-Tate

abstract: We prove non-trivial upper bounds for general bilinear forms with trace functions of bountiful sheaves, where the supports of two variables can be arbitrary subsets in $\mathbf{F}_p$ of suitable sizes. This essentially recovers the P\'olya-Vinogradov range, and also applies to symmetric powers of Kloosterman sums and Frobenius traces of elliptic curves. In the case of hyper-Kloosterman sums, we can beat the P\'olya-Vinogradov barrier by combining additive combinatorics with a deep result of Kowalski, Michel and Sawin on sum-products of Kloosterman sheaves. Two Sato-Tate distributions of Kloosterman sums and Frobenius traces of elliptic curves in sparse families are also concluded.


title: Exploring Consistency in Cross-Domain Transformer for Domain Adaptive Semantic Segmentation

abstract: While transformers have greatly boosted performance in semantic segmentation, domain adaptive transformers are not yet well explored. We identify that the domain gap can cause discrepancies in self-attention. Due to this gap, the transformer attends to spurious regions or pixels, which deteriorates accuracy on the target domain. We propose to perform adaptation on attention maps with cross-domain attention layers that share features between the source and the target domains. Specifically, we impose consistency between predictions from cross-domain attention and self-attention modules to encourage similar distribution in the attention and output of the model across domains, i.e., attention-level and output-level alignment. We also enforce consistency in attention maps between different augmented views to further strengthen the attention-based alignment. Combining these two components, our method mitigates the discrepancy in attention maps across domains and further boosts the performance of the transformer under unsupervised domain adaptation settings. Our model outperforms the existing state-of-the-art baseline model on three widely used benchmarks, including GTAV-to-Cityscapes by 1.3 percent point (pp), Synthia-to-Cityscapes by 0.6 pp, and Cityscapes-to-ACDC by 1.1 pp, on average. Additionally, we verify the effectiveness and generalizability of our method through extensive experiments. Our code will be publicly available.


title: Quantum State Transfer in Graphs with Tails

abstract: We consider quantum state transfer on finite graphs which are attached to infinite paths. The finite graph represents an operational quantum system for performing useful quantum information tasks. In contrast, the infinite paths represent external infinite-dimensional systems which have limited (but nontrivial) interaction with the finite quantum system. We show that {\em perfect} state transfer can surprisingly still occur on the finite graph even in the presence of the infinite tails. Our techniques are based on a decoupling theorem for eventually-free Jacobi matrices, equitable partitions, and standard Lie theoretic arguments. Through these methods, we rehabilitate the notion of a dark subspace which had been so far viewed in an unflattering light.


abstract: Vision Transformers have achieved remarkable progresses, among which Swin Transformer has demonstrated the tremendous potential of Transformer for vision tasks. It surmounts the key challenge of high computational complexity by performing local self-attention within shifted windows. In this work we propose the Semantic-Aware Local-Global Vision Transformer (SALG), to further investigate two potential improvements towards Swin Transformer. First, unlike Swin Transformer that performs uniform partition to produce equal size of regular windows for local self-attention, our SALG performs semantic segmentation in an unsupervised way to explore the underlying semantic priors in the image. As a result, each segmented region can correspond to a semantically meaningful part in the image, potentially leading to more effective features within each of segmented regions. Second, instead of only performing local self-attention within local windows as Swin Transformer does, the proposed SALG performs both 1) local intra-region self-attention for learning fine-grained features within each region and 2) global inter-region feature propagation for modeling global dependencies among all regions. Consequently, our model is able to obtain the global view when learning features for each token, which is the essential advantage of Transformer. Owing to the explicit modeling of the semantic priors and the proposed local-global modeling mechanism, our SALG is particularly advantageous for small-scale models when the modeling capacity is not sufficient for other models to learn semantics implicitly. Extensive experiments across various vision tasks demonstrates the merit of our model over other vision Transformers, especially in the small-scale modeling scenarios.


title: Neural Network Verification as Piecewise Linear Optimization: Formulations for the Composition of Staircase Functions

abstract: We present a technique for neural network verification using mixed-integer programming (MIP) formulations. We derive a \emph{strong formulation} for each neuron in a network using piecewise linear activation functions. Additionally, as in general, these formulations may require an exponential number of inequalities, we also derive a separation procedure that runs in super-linear time in the input dimension. We first introduce and develop our technique on the class of \emph{staircase} functions, which generalizes the ReLU, binarized, and quantized activation functions. We then use results for staircase activation functions to obtain a separation method for general piecewise linear activation functions. Empirically, using our strong formulation and separation technique, we can reduce the computational time in exact verification settings based on MIP and improve the false negative rate for inexact verifiers relying on the relaxation of the MIP formulation.


title: Quasiexact posets and the moderate meet-continuity

abstract: The study of weak domains and quasicontinuous domains leads to the consideration of two types generalizations of domains. In the current paper, we define the weak way-below relation between two nonempty subsets of a poset and quasiexact posets. We prove some connections among quasiexact posets, quasicontinuous domains and weak domains. Furthermore, we introduce the weak way-below finitely determined topology and study its links to Scott topology and the weak way-below topology first considered by Mushburn. It is also proved that a dcpo is a domain if it is quasiexact and moderately meet continuous with the weak way-below relation weakly increasing.


title: Identifying Chemicals Through Dimensionality Reduction

abstract: Civilizations have tried to make drinking water safe to consume for thousands of years. The process of determining water contaminants has evolved with the complexity of the contaminants due to pesticides and heavy metals. The routine procedure to determine water safety is to use targeted analysis which searches for specific substances from some known list; however, we do not explicitly know which substances should be on this list. Before experimentally determining which substances are contaminants, how do we answer the sampling problem of identifying all the substances in the water? Here, we present an approach that builds on the work of Jaanus Liigand et al., which used non-targeted analysis that conducts a broader search on the sample to develop a random-forest regression model, to predict the names of all the substances in a sample, as well as their respective concentrations[1]. This work utilizes techniques from dimensionality reduction and linear decompositions to present a more accurate model using data from the European Massbank Metabolome Library to produce a global list of chemicals that researchers can then identify and test for when purifying water.


title: Open-Source Ground-based Sky Image Datasets for Very Short-term Solar Forecasting, Cloud Analysis and Modeling: A Comprehensive Survey

abstract: Sky-image-based solar forecasting using deep learning has been recognized as a promising approach in reducing the uncertainty in solar power generation. However, one of the biggest challenges is the lack of massive and diversified sky image samples. In this study, we present a comprehensive survey of open-source ground-based sky image datasets for very short-term solar forecasting (i.e., forecasting horizon less than 30 minutes), as well as related research areas which can potentially help improve solar forecasting methods, including cloud segmentation, cloud classification and cloud motion prediction. We first identify 72 open-source sky image datasets that satisfy the needs of machine/deep learning. Then a database of information about various aspects of the identified datasets is constructed. To evaluate each surveyed datasets, we further develop a multi-criteria ranking system based on 8 dimensions of the datasets which could have important impacts on usage of the data. Finally, we provide insights on the usage of these datasets for different applications. We hope this paper can provide an overview for researchers who are looking for datasets for very short-term solar forecasting and related areas.


title: 3DPPE: 3D Point Positional Encoding for Multi-Camera 3D Object Detection Transformers

abstract: Transformer-based methods have swept the benchmarks on 2D and 3D detection on images. Because tokenization before the attention mechanism drops the spatial information, positional encoding becomes critical for those methods. Recent works found that encodings based on samples of the 3D viewing rays can significantly improve the quality of multi-camera 3D object detection. We hypothesize that 3D point locations can provide more information than rays. Therefore, we introduce 3D point positional encoding, 3DPPE, to the 3D detection Transformer decoder. Although 3D measurements are not available at the inference time of monocular 3D object detection, 3DPPE uses predicted depth to approximate the real point positions. Our hybriddepth module combines direct and categorical depth to estimate the refined depth of each pixel. Despite the approximation, 3DPPE achieves 46.0 mAP and 51.4 NDS on the competitive nuScenes dataset, significantly outperforming encodings based on ray samples. We make the codes available at https://github.com/drilistbox/3DPPE.


title: Development of a Modular Real-time Shared-control System for a Smart Wheelchair

abstract: In this paper, we propose a modular navigation system that can be mounted on a regular powered wheelchair to assist disabled children and the elderly with autonomous mobility and shared-control features. The lack of independent mobility drastically affects an individual's mental and physical health making them feel less self-reliant, especially children with Cerebral Palsy and limited cognitive skills. To address this problem, we propose a comparatively inexpensive and modular system that uses a stereo camera to perform tasks such as path planning, obstacle avoidance, and collision detection in environments with narrow corridors. We avoid any major changes to the hardware of the wheelchair for an easy installation by replacing wheel encoders with a stereo camera for visual odometry. An open source software package, the Real-Time Appearance Based Mapping package, running on top of the Robot Operating System (ROS) allows us to perform visual SLAM that allows mapping and localizing itself in the environment. The path planning is performed by the move base package provided by ROS, which quickly and efficiently computes the path trajectory for the wheelchair. In this work, we present the design and development of the system along with its significant functionalities. Further, we report experimental results from a Gazebo simulation and real-world scenarios to prove the effectiveness of our proposed system with a compact form factor and a single stereo camera.


title: A new method for overconvergence of {{\((\varphi ,\Gamma)\)}}-modules

abstract: We show all Laurent $F$-crystals over $p$-adic fields are overconvergent.


title: Compacitification and positive mass theorem for fibered Euclidean end

abstract: In this note, we consider the positive mass theorem for Riemannian manifolds $(M^{n},g)$ asymptotic to $(\mathbb{R}^{k}\times X^{n-k}, g_{\mathbb{R}^{k}}+g_{X})$ for $k\geq 3$ by studying the corresponding compactification problem.


title: Coverage Analysis for Cellular-Connected Random 3D Mobile UAVs with Directional Antennas

abstract: This letter proposes an analytical framework to evaluate the coverage performance of a cellular-connected unmanned aerial vehicle (UAV) network in which UAV user equipments (UAV-UEs) are equipped with directional antennas and move according to a three-dimensional (3D) mobility model. The ground base stations (GBSs) equipped with practical down-tilted antennas are distributed according to a Poisson point process (PPP). With tools from stochastic geometry, we derive the handover probability and coverage probability of a random UAV-UE under the strongest average received signal strength (RSS) association strategy. The proposed analytical framework allows to investigate the effect of UAV-UE antenna beamwidth, mobility speed, cell association, and vertical motions on both the handover probability and coverage probability. We conclude that the optimal UAV-UE antenna beamwidth decreases with the GBS density, and the omnidirectional antenna model is preferred in the sparse network scenario. What's more, the superiority of the strongest average RSS association over the nearest association diminishes with the increment of GBS density.


title: A Knowledge-based Learning Framework for Self-supervised Pre-training Towards Enhanced Recognition of Biomedical Microscopy Images

abstract: Self-supervised pre-training has become the priory choice to establish reliable neural networks for automated recognition of massive biomedical microscopy images, which are routinely annotation-free, without semantics, and without guarantee of quality. Note that this paradigm is still at its infancy and limited by closely related open issues: 1) how to learn robust representations in an unsupervised manner from unlabelled biomedical microscopy images of low diversity in samples? and 2) how to obtain the most significant representations demanded by a high-quality segmentation? Aiming at these issues, this study proposes a knowledge-based learning framework (TOWER) towards enhanced recognition of biomedical microscopy images, which works in three phases by synergizing contrastive learning and generative learning methods: 1) Sample Space Diversification: Reconstructive proxy tasks have been enabled to embed a priori knowledge with context highlighted to diversify the expanded sample space; 2) Enhanced Representation Learning: Informative noise-contrastive estimation loss regularizes the encoder to enhance representation learning of annotation-free images; 3) Correlated Optimization: Optimization operations in pre-training the encoder and the decoder have been correlated via image restoration from proxy tasks, targeting the need for semantic segmentation. Experiments have been conducted on public datasets of biomedical microscopy images against the state-of-the-art counterparts (e.g., SimCLR and BYOL), and results demonstrate that: TOWER statistically excels in all self-supervised methods, achieving a Dice improvement of 1.38 percentage points over SimCLR. TOWER also has potential in multi-modality medical image analysis and enables label-efficient semi-supervised learning, e.g., reducing the annotation cost by up to 99% in pathological classification.


title: Fingerprint Pore Detection: A Survey

abstract: This work presents the first survey on fingerprint pore detection. The survey provides a general overview of the field and discusses methods, datasets, and evaluation protocols. We also present a baseline method inspired on the state-of-the-art that implements a customizable Fully Convolutional Network, whose hyperparameters were tuned to achieve optimal pore detection rates. Finally, we also reimplementated three other approaches proposed in the literature for evaluation purposes. We have made the source code of (1) the baseline method, (2) the reimplemented approaches, and (3) the training and evaluation processes for two different datasets available to the public to attract more researchers to the field and to facilitate future comparisons under the same conditions. The code is available in the following repository: https://github.com/azimIbragimov/Fingerprint-Pore-Detection-A-Survey